-- Logs begin at Wed 2022-07-20 10:42:15 UTC, end at Wed 2022-07-20 11:59:51 UTC. -- Jul 20 11:25:57.351942 dv-cinder-822822-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 11:25:57.360064 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 11:25:57.362098 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 11:25:57 2022] *** Jul 20 11:25:57.362098 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 11:25:57.362098 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 11:25:57.362098 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: nodename: dv-cinder-822822-4-iscsi Jul 20 11:25:57.362098 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: machine: x86_64 Jul 20 11:25:57.362098 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: clock source: unix Jul 20 11:25:57.362098 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: pcre jit disabled Jul 20 11:25:57.362614 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: detected number of CPU cores: 4 Jul 20 11:25:57.362614 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: current working directory: / Jul 20 11:25:57.362614 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: detected binary path: /usr/bin/uwsgi-core Jul 20 11:25:57.362614 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: your processes number limit is 47680 Jul 20 11:25:57.362614 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: your memory page size is 4096 bytes Jul 20 11:25:57.362614 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: detected max file descriptor number: 2048 Jul 20 11:25:57.362614 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: lock engine: pthread robust mutexes Jul 20 11:25:57.362614 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: thunder lock: enabled Jul 20 11:25:57.362614 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 11:25:57.362614 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 11:25:57.407592 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: Python main interpreter initialized at 0x55967477e9c0 Jul 20 11:25:57.407592 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: python threads support enabled Jul 20 11:25:57.407592 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: your server socket listen backlog is limited to 100 connections Jul 20 11:25:57.407592 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: your mercy for graceful operations on workers is 90 seconds Jul 20 11:25:57.407983 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 11:25:57.408066 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: *** Operational MODE: preforking *** Jul 20 11:25:57.408303 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: *** uWSGI is running in multiple interpreter mode *** Jul 20 11:25:57.408303 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: spawned uWSGI master process (pid: 103822) Jul 20 11:25:57.408521 dv-cinder-822822-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 11:25:57.409632 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: spawned uWSGI worker 1 (pid: 103823, cores: 1) Jul 20 11:25:57.409632 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: spawned uWSGI worker 2 (pid: 103824, cores: 1) Jul 20 11:25:57.409632 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 11:25:58.075310 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 11:25:58.084728 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 11:25:59.193701 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 11:25:59.193701 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: from cryptography.utils import int_from_bytes Jul 20 11:25:59.194298 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 11:25:59.194298 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: from cryptography.utils import int_from_bytes Jul 20 11:25:59.252002 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 11:25:59.252002 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: from cryptography.utils import int_from_bytes Jul 20 11:25:59.252550 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 11:25:59.252550 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: from cryptography.utils import int_from_bytes Jul 20 11:26:01.697934 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 11:26:01.698506 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 11:26:01.698603 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 11:26:01.698970 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 11:26:01.699083 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 11:26:01.699083 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 11:26:01.699222 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 11:26:01.699295 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 11:26:01.699507 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 11:26:01.699619 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.699762 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 11:26:01.699944 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.700147 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.700244 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.700471 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.700564 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.700806 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.700909 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.701136 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.701239 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.701472 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.701580 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.701781 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.701878 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.702101 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.702196 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.702358 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.702453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.702668 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.702767 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.702976 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.703072 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-4-iscsi {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.703289 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.703383 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.703590 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.703692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-4-iscsi {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.703892 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.703991 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.704210 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.704311 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.704509 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.704611 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.704859 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.704962 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.705167 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.705314 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.705486 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.705653 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.705778 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.706085 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.706269 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.706382 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.706583 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.706679 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.706891 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.706992 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.707186 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.707290 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.707521 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.707625 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.707832 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.707929 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.708138 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.708244 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.708456 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.708550 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.708756 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.708893 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.709123 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.709210 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-4-iscsi {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.709414 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.709518 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.709770 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.709860 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-4-iscsi {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.710077 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.710172 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.710409 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.710509 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.710723 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.710826 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.711062 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.711159 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.711376 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.711477 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.711695 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.711817 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.711998 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.712097 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.712319 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.712408 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.712632 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.712720 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.713004 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.713095 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.713322 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.713421 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.713620 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.713714 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.713925 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.714025 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.714233 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.714321 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.714540 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.714629 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.714838 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.714946 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.715142 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.715245 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.715387 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.715492 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.715689 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.715786 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.715970 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.716058 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.716276 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.716377 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.716595 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.716691 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.716863 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.716968 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.717112 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.717255 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.717428 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.717565 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.717741 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.717831 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.718041 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.718136 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.718345 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.718440 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.718647 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.718745 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.718947 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.719042 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.719250 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.719383 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.719550 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.719654 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.719851 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.719946 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.720149 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.720243 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.720452 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.720559 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.720757 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.720858 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.721092 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.721198 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.721393 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.721495 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.721707 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.721803 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.722010 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.722102 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.722328 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.722416 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.722629 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.722717 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.722961 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.723054 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.723267 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.723358 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.723567 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.723662 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.723878 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.723976 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.724197 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.724294 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.724496 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.724586 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.724833 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.724975 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.725101 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.725304 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.725421 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.725724 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.725849 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.726021 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.726269 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.726564 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.726917 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.727174 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.727273 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.727507 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.727672 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.727811 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.727907 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.728114 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.728204 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.728936 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.729043 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.729241 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.729336 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.729543 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.729650 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.729843 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.729936 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.730144 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.730247 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.730444 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.730542 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.730742 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.730839 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.731042 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.731131 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.731337 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.731435 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.731636 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.731732 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.731938 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.732028 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.732242 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.732345 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.732542 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.732630 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.732865 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.732957 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.733164 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.733265 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.733465 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.733555 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.733764 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.733857 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.734065 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.734170 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.734365 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.734456 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.734682 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.734769 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.734980 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.735080 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.735289 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.735424 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.735582 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.735677 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.735880 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.735981 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.736180 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.736279 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.736483 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.736571 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.736775 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.736889 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.737096 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.737186 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.737406 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.737496 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.737705 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.737805 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.738003 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.738100 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.738299 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.738393 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.738594 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.738691 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.738891 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.738980 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.739190 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.739287 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.739485 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.739619 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.739781 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.739870 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.740074 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.740171 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.740374 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.740469 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.740676 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.740766 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.741000 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.741096 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.741303 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.741392 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.741598 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.741692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.741898 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.741998 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.742199 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.742295 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.742514 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.742610 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.742832 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.742935 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.743138 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.743233 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.743451 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.743551 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.743755 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.743856 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.744646 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:26:01.744749 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.745005 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.745106 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.745338 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.745436 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.745659 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.745754 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.745965 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.746058 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.746274 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.746374 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.746582 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.746671 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.746897 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.746992 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.747208 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.747298 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.747520 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.747607 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.747830 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.747917 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.748142 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.748241 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.748452 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.748548 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.748756 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.748895 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.749090 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.749181 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.749405 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.749493 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.749718 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.749805 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.750024 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.750121 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.750344 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.750431 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.750662 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.750757 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.750972 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.751062 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.751285 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.751372 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.751597 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.751693 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.751903 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.752033 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.752208 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.752297 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.752511 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.752611 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.752850 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.752945 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.753178 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.753279 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.753485 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.753583 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.753798 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.753888 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.754103 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.754192 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.754410 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.754513 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.754719 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.755065 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.755274 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.755363 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.755580 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.755670 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.755905 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.755994 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.756210 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.756298 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.756518 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.756606 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.756845 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.756935 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.757156 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.757254 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.757462 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.757551 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.757772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.757860 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.758074 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.758164 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.758374 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.758465 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.758673 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.758769 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.758973 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.759070 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.759275 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.759372 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.759596 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.759685 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.759912 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.760012 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.760223 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.760311 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.760523 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.760610 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.760850 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.760957 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.761160 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.761251 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.761464 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.761551 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.761767 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.761866 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.762069 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.762150 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.762368 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.762464 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.762672 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.762770 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.762973 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.763116 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.763275 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.763376 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.763593 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.763692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.763898 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.763987 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.764197 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.764286 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.764503 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.764602 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.764827 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.764938 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.765132 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.765221 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.765441 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.765530 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.765744 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.765838 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.766050 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.766138 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.766357 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.766445 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.766660 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.766748 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.766974 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.767071 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.767280 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.767376 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.767588 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.767678 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.767898 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.767994 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.768211 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.768302 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.768514 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.768609 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.768844 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.768950 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.769167 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.769263 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.769479 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.769567 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.769779 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.769905 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.770083 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.770181 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.770383 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.770473 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.770682 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.770774 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.770982 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.771078 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.771286 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.771376 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.771586 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.771695 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.771886 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.771985 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.772185 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.772274 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.772485 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.772582 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.772824 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.772929 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.773125 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.773223 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.773428 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.773517 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.773731 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.773819 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.774029 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.774125 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.774330 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.774416 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.774635 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.774724 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.774939 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.775041 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.775785 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.775889 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.776095 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.776184 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.776400 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.776503 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.776705 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.776821 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.777037 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.777127 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.777355 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.777453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.777662 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.777760 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.777968 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.778059 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.778278 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.778382 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.778582 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.778671 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.778897 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.778986 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.779205 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.779296 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.779517 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.779606 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.779822 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.779922 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.780125 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.780215 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.780429 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.780518 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.780740 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.780872 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.781065 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.781163 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.781376 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.781465 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.781693 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.781789 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.782005 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.782095 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.782323 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.782412 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.782631 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.782732 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.782936 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.783025 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.783241 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.783338 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.783544 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.783640 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.783849 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.783939 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.784153 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.784249 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.784460 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.784558 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.784777 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.784884 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.785111 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.785199 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.785425 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.785516 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.785731 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.785820 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.786039 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.786137 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.786342 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.786447 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.786651 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.786740 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.786951 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.787044 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.787260 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.787394 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.787575 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.787670 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.787887 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.787975 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.788189 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.788314 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.788495 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.788585 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.788835 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.788959 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.789144 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.789246 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.789449 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.789558 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.789754 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.789866 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.790056 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.790157 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.790357 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.790446 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.790660 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.790759 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.791553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.791650 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.791848 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.791936 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.792159 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.792257 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.792469 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.792556 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.792772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.792923 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.793099 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.793203 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.793401 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.793498 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.793706 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.793796 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.794015 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.794105 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.794322 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.794417 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.794627 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.794716 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.794942 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.795039 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.795250 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.795340 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.795550 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.795636 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.795852 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.795943 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.796163 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.796262 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.796465 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.796559 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.796766 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.796887 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.797090 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.797180 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.797391 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.797496 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.797720 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.797809 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.798026 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.798113 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.798401 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.798511 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.798650 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.798742 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.798945 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.799039 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.799250 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.799351 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.799552 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.799647 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.799857 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.799946 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.800161 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.800264 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.800478 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.800567 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.800805 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.800908 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.801117 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.801208 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.801422 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.801518 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.801727 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.801817 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.802033 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.802124 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.802338 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.802435 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.802654 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.802750 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.802958 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.803049 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.803263 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.803352 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.803564 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.803653 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.803864 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.803962 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.804168 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.804259 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.804474 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.804570 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.804817 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.805063 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.805168 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.805392 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.805483 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.805704 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.805806 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.806008 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.806096 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.806320 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.806448 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.806654 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.806743 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.806981 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.807208 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.807310 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.807542 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.807639 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.807859 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.807957 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.808179 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.808267 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.808499 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.808587 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.808816 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.808907 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.809126 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.809228 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.809427 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.809518 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.809725 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.809815 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.810023 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.810125 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.810324 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.810413 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.810623 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.810721 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.810920 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.811009 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.811218 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.811317 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.811516 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.811608 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.811823 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.811919 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.812119 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.812209 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.812422 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.812518 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.812718 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.812853 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.813052 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.813151 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.813354 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.813443 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.813652 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.813743 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.813948 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.814038 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.814246 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.814337 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.814559 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.814647 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.814864 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.814965 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.815188 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.815285 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.815498 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.815587 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.815829 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.815926 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.816131 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.816215 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.816432 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.816531 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.816750 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.816873 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.817074 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.817165 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.817376 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.817466 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.817675 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.817774 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.817980 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.818069 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.818282 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.818370 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.818582 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.818673 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.818889 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.818978 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.819194 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.819295 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.819497 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.819588 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.819800 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.819888 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.820096 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.820191 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.820399 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.820490 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.820700 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.820807 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.821031 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.821120 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.821335 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.821432 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.821635 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.821730 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.821934 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.822032 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.822259 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.822348 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.822560 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.822647 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.822859 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.822956 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.823160 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.823250 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.823458 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.823548 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.823763 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.823860 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.824062 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.824149 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.824361 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.824451 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.824662 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.824759 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.824990 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.825090 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.825296 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.825384 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.825594 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.825691 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.825909 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.826013 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.826213 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.826301 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.826514 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.826613 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.826812 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.826907 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.827114 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.827202 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.827411 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.827502 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.827708 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.827802 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.828011 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.828107 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.828324 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.828414 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.828629 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.828804 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.828951 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.829058 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.829254 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.829343 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.829552 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.829641 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.829848 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.829950 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.830147 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.830245 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.830448 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.830584 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.830746 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.830847 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.831041 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.831132 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.831338 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.831426 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.831634 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.831731 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.831930 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.832021 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.832231 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.832318 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.832540 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.832631 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.832863 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.832967 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.833163 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.833257 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.833460 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.833597 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.833763 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.833852 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.834065 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.834154 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.834387 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.834484 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.834695 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.834784 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.834997 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.835092 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.835300 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.835399 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.835603 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.835693 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.835905 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.836005 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.836213 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.836302 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.836514 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.836602 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.836847 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.836952 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.837157 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.837246 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.837462 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.837551 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.838311 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.838463 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.838620 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.838934 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.839022 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.839239 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.839494 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.839598 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.839846 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.840020 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.840156 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.840458 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.840545 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.840748 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.841092 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.841182 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.841402 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.841642 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.841741 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.842015 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.842217 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.842336 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.842657 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.842785 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.842961 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.843243 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.843339 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.843564 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.843652 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.843868 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.843965 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.844176 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.844272 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.844488 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.844577 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.844806 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.844912 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.845128 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.845217 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.845437 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.845528 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.845745 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.845857 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.846054 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.846146 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.846356 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.846445 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.846663 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.846752 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.846967 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.847054 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.847269 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.847359 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.847591 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.847687 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.847896 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.847983 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.848198 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.848295 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.848508 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.848603 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.848918 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.849013 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.849117 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.849224 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.849418 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.849508 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.849839 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.849927 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.850149 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.850247 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.850457 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.850548 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.850760 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.850857 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.851066 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.851164 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.851374 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.851463 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.851684 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.851771 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.851994 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.852094 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.852295 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.852384 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.852706 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.852814 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.853040 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.853133 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.853392 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.853978 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.854206 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.854295 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.854521 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.854619 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.854822 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.854916 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.855127 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.855215 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.855443 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.855533 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.855743 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.855831 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.856048 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.856137 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.856351 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.856442 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.856673 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.856765 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.857002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.857104 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.857320 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.857410 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.857729 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.857819 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.858036 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.858134 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.858339 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.858428 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.858749 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.858849 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.859054 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.859152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.859360 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.859458 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.859679 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.859775 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.859994 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.860095 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.860317 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.860433 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.860617 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.860768 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.860952 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.861262 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.861367 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.861583 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.861687 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.861902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.861996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.862210 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.862319 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.862518 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.862621 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.862819 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.862921 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.863136 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.863268 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.863464 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.863728 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.863832 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.864057 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.864150 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.864415 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.864525 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.864824 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.864922 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.865500 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.865588 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.865660 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.865728 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.865802 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.865884 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.866054 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.866144 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.866320 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.866421 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.866619 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.866717 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.866926 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.867022 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.867230 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.867322 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.868829 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.869060 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.869234 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.869392 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.869543 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.869693 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.869851 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.870002 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.870161 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.870319 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.870475 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.870643 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.870792 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.870953 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.871110 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.871258 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.871409 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.871563 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.871711 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.871866 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.872015 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.872169 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.872318 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.872412 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.872495 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.872595 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.872686 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.872769 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.872918 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.873004 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.873097 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.873190 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.873274 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.873355 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.873436 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.873517 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.873606 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.873689 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.873769 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.873850 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.873937 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.874019 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.874109 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.874240 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.874331 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.874414 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.874494 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.874575 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.874732 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.874878 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.875042 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.875191 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.875372 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.875525 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.875705 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.875852 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.876018 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.876169 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.876333 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.876486 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.876657 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.876847 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.876995 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.877135 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.877275 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.877438 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.877582 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.877746 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.877884 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.878048 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.878186 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.878352 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.878489 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.878673 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.878819 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.878963 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.879081 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.879265 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.879365 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.879567 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.879657 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.880124 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.880230 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.880443 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.880534 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.880748 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.880854 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.881097 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.881203 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.881405 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.881496 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.881708 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.881804 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.882005 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.882106 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.882305 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.882393 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.882635 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.882724 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.882936 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.883032 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.883266 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.883356 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.883581 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.883677 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.883905 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.883996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.884211 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.884347 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.884544 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.884636 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.884892 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.884986 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.885208 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.885312 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.885522 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.885611 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.885833 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.885930 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.886143 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.886239 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.886453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.886547 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.886762 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.886851 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.887069 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.887165 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.887374 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.887470 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.887683 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.887771 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.887994 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.888081 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.888312 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.888533 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.888872 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.888966 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.889186 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.889286 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.889496 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.889601 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.889804 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.889894 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.890113 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.890201 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.890419 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.890520 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.890725 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.890822 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.891033 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.891123 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.891342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.891441 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.891646 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.891735 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.891955 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.892045 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.892274 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.892363 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.892594 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.892684 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.892942 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.893036 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.893257 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.893349 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.893568 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.893659 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.893878 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.893977 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.894188 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.894278 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.894506 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.894612 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.894833 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.894938 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.895137 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.895228 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.895447 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.895547 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.895758 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.895849 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.896063 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.896152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.896368 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.896465 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.896673 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.896764 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.897006 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.897099 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.897313 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.897415 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.897619 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.897712 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.897923 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.898013 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.898231 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.898330 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.898539 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.898636 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.898857 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.898946 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.899178 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.899283 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.899487 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.899585 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.899795 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.899884 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.900103 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.900710 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.900953 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.901047 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.901267 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.901468 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.901778 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.901869 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.902089 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.902177 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.902416 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.902506 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.902738 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.902832 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.903047 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.903144 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.903358 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.903450 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.903672 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.903763 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.903971 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.904059 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.904272 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.904371 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.904579 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.904669 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.904910 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.905007 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.905213 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.905316 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.905515 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.905611 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.905822 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.905910 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.906125 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.906224 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.906426 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.906516 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.906732 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.906820 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.907038 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.907258 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.907563 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.907653 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.907902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.907990 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.908215 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.908304 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.908536 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.908624 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.908876 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.908969 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.909183 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.909275 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.909488 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.909576 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.909792 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.909880 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.910094 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.910186 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.910398 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.910493 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.910703 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.910792 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.911005 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.911100 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.911307 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.911397 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.911610 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.911707 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.911911 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.911999 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.912210 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.912301 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.912510 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.912606 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.912834 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.912950 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.913140 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.913241 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.913447 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.913554 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.913747 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.913847 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.914047 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.914137 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.914350 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.914450 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.914651 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.914753 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.914949 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.915048 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.915249 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.915347 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.915548 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.915638 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.916382 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.916477 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.916694 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.916807 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.917021 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.917123 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.917390 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.917494 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.917627 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.917717 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.917924 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.918013 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.918228 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.918318 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.918535 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.918626 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.918879 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.918967 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.919190 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.919287 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.919483 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.919582 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.919783 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.919872 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.920087 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.920185 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.920398 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.920486 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.920703 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.920813 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.921033 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.921136 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.921346 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.921435 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.921671 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.921761 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.921989 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.922197 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.922521 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.922610 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.922836 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.922937 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.923161 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.923253 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.923486 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.923582 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.923792 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.923882 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.924096 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.924194 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.924397 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.924499 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.924706 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.924882 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.925035 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.925176 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.925314 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.925452 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.925620 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.925724 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.925926 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.926018 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.926230 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.926327 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.926540 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.926640 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.926858 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.926952 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.927146 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.927236 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.927449 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.927595 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.927775 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.927881 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.928055 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.928146 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.928359 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.928458 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.928659 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.928755 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.928991 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.929084 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.929372 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.929485 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.929623 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.929714 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.929933 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.930023 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.930243 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.930342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.930554 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.930645 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.930858 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.930948 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.931163 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.931254 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.931493 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.931613 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.931804 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.931926 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.932114 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.932238 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.932428 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.932563 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.932758 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.932991 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.933086 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.933176 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.933394 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.933583 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.933814 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.933913 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.934129 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.934221 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.934449 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.934539 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.934774 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.934902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.935086 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.935176 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.935401 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.935490 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.935708 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.935806 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.936020 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.936110 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.936324 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.936419 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.936638 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.936727 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.936993 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.937087 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.937318 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.937420 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.937638 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.937730 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.937941 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.938038 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.938244 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.938343 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.938543 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.938633 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.938845 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.938941 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.939155 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.939253 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.939461 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.939584 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.939764 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.939866 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.940062 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.940169 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.940361 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.940465 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.940658 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.940762 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.940978 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.941077 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.941276 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.941374 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.941575 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.941666 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.941877 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.941968 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.942172 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.942260 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.942469 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.942559 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.942767 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.942858 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.943066 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.943168 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.943362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.943463 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.943658 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.943747 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.943959 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.944056 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.944254 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.944356 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.944553 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.944643 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.944871 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.944978 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.945169 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.945280 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.945465 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.945555 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.945765 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.945854 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.946098 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.946195 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.946404 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.946492 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.946725 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.946814 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.947042 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.947134 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.947367 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.947459 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.947673 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.947785 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.948027 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.948126 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.948293 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.948382 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.948603 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.948703 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.948928 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.949023 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.949252 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.949341 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.949557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.949663 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.949863 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.949972 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.950169 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.950268 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.950473 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.950580 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.950778 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.950876 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.951084 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.951182 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.951395 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.951503 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.951713 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.951809 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.952016 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.952123 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.952328 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.952434 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.952637 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.952734 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.952976 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.953148 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.953307 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.953449 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.953593 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.953730 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.953888 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.954034 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.954181 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.954392 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.954534 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.954677 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.954813 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.954950 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.955074 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.955264 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.955404 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.955539 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.955676 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.955822 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.955960 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.956104 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.956247 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.956385 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.956559 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.956713 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.956882 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.956972 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.957201 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.957291 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.957522 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.957625 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.957828 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.957930 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.958148 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.958238 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.958469 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.958567 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.958796 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.958886 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.959101 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.959191 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.959439 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.959531 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.959763 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.959853 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.960073 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.960171 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.960381 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.960473 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.960683 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.960772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.960946 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 11:26:01.961044 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:26:01.961246 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 11:26:02.022779 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO dbcounter [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] Registered counter for database nova_api Jul 20 11:26:02.023288 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO dbcounter [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Registered counter for database nova_api Jul 20 11:26:02.136117 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_db.sqlalchemy.engines [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:26:02.138638 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG oslo_db.sqlalchemy.engines [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:26:02.142633 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writer thread running {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:26:02.145010 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG dbcounter [-] [103823] Writer thread running {{(pid=103823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:26:02.197618 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.context [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e43e925f-fe8b-4c11-b417-df3450f348d9(cell1) {{(pid=103824) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 11:26:02.199681 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.context [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e43e925f-fe8b-4c11-b417-df3450f348d9(cell1) {{(pid=103823) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 11:26:02.201566 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.203135 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.203569 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG oslo_concurrency.lockutils [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.203926 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.205172 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG oslo_concurrency.lockutils [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.205948 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG oslo_concurrency.lockutils [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.206061 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.208000 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO dbcounter [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Registered counter for database nova_cell0 Jul 20 11:26:02.208092 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG oslo_concurrency.lockutils [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.210014 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO dbcounter [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] Registered counter for database nova_cell0 Jul 20 11:26:02.212121 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO dbcounter [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Registered counter for database nova_cell1 Jul 20 11:26:02.214376 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO dbcounter [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] Registered counter for database nova_cell1 Jul 20 11:26:02.219824 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_db.sqlalchemy.engines [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:26:02.221441 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_db.sqlalchemy.engines [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:26:02.223293 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG oslo_db.sqlalchemy.engines [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:26:02.224983 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG oslo_db.sqlalchemy.engines [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:26:02.227289 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writer thread running {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:26:02.229402 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writer thread running {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:26:02.230438 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG dbcounter [-] [103823] Writer thread running {{(pid=103823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:26:02.233004 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG dbcounter [-] [103823] Writer thread running {{(pid=103823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:26:02.378338 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO dbcounter [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] Registered counter for database nova_cell0 Jul 20 11:26:02.386265 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO dbcounter [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Registered counter for database nova_cell0 Jul 20 11:26:02.388003 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG oslo_db.sqlalchemy.engines [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:26:02.392474 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG dbcounter [-] [103823] Writer thread running {{(pid=103823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:26:02.396484 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_db.sqlalchemy.engines [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:26:02.401340 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writer thread running {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:26:02.823235 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: WARNING keystonemiddleware.auth_token [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 11:26:02.830581 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: WARNING keystonemiddleware.auth_token [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 11:26:02.851894 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: WARNING keystonemiddleware.auth_token [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 11:26:02.859678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: WARNING keystonemiddleware.auth_token [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 11:26:03.181293 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: WARNING keystonemiddleware.auth_token [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 11:26:03.187859 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: WARNING keystonemiddleware.auth_token [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 11:26:03.193296 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55967477e9c0 pid: 103824 (default app) Jul 20 11:26:03.195375 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:03.204175 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Jul 20 11:26:03.204175 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Wed Jul 20 11:26:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:03.228816 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: WARNING keystonemiddleware.auth_token [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 11:26:03.234790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: WARNING keystonemiddleware.auth_token [None req-4aa19617-e2ef-4f8a-a92e-49865320a060 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 11:26:03.240011 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55967477e9c0 pid: 103823 (default app) Jul 20 11:27:22.564125 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:22.565178 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 20 11:27:22.565576 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:27:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:22.581382 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG dbcounter [-] [103823] Writing DB stats nova_api:SELECT=3 {{(pid=103823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:22.582599 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG dbcounter [-] [103823] Writing DB stats nova_cell0:SELECT=3 {{(pid=103823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:22.583950 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG dbcounter [-] [103823] Writing DB stats nova_cell1:SELECT=3 {{(pid=103823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:22.584959 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG dbcounter [-] [103823] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:23.473283 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-12d5a921-c1fe-4659-a8c0-00d7fbdbf870 admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:23.503041 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-12d5a921-c1fe-4659-a8c0-00d7fbdbf870 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930706 Jul 20 11:27:23.503807 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jul 20 11:27:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:25.736394 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:25.737411 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-17be979d-05e5-4f7c-aafd-d2ec8d0e2421 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 20 11:27:25.737798 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:27:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:26.223627 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-166ae384-4490-43b9-9765-561ac7b9ebae admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "disk": 1, "vcpus": 1}} {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:26.242514 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:27:26.242514 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: warnings.warn(msg) Jul 20 11:27:26.335065 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-166ae384-4490-43b9-9765-561ac7b9ebae admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.591347 Jul 20 11:27:26.335631 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 11:27:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:27:26.350115 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writing DB stats nova_api:SELECT=3 {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:26.351469 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writing DB stats nova_cell0:SELECT=3 {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:26.352152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writing DB stats nova_cell1:SELECT=3 {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:26.353198 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:26.557013 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-e00cf9fe-0ef0-44d6-a9a5-99aea52aab7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:26.559426 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:27:26.559426 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: warnings.warn(msg) Jul 20 11:27:26.738410 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-e00cf9fe-0ef0-44d6-a9a5-99aea52aab7f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.393270 Jul 20 11:27:26.739405 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jul 20 11:27:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:29.004926 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-166ae384-4490-43b9-9765-561ac7b9ebae admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:29.006600 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-166ae384-4490-43b9-9765-561ac7b9ebae admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002137 Jul 20 11:27:29.007369 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:27:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:29.670370 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-c92e259b-99e2-49ff-8524-e4a82226f170 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "vcpus": 1, "disk": 5, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:29.688684 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:27:29.688684 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: warnings.warn(msg) Jul 20 11:27:29.807380 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-c92e259b-99e2-49ff-8524-e4a82226f170 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.793500 Jul 20 11:27:29.808123 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 11:27:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:27:29.820361 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-0d1d4cc9-4e3b-4d5c-b30d-155a97ded307 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:29.823154 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:27:29.823154 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: warnings.warn(msg) Jul 20 11:27:29.926396 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-0d1d4cc9-4e3b-4d5c-b30d-155a97ded307 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110313 Jul 20 11:27:29.926979 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jul 20 11:27:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:32.151748 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-c92e259b-99e2-49ff-8524-e4a82226f170 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:32.152759 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-c92e259b-99e2-49ff-8524-e4a82226f170 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 20 11:27:32.154473 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:27:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:32.549612 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-53e36c2d-3d3c-4f31-8959-c4668ee46efa admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 1}} {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:32.688049 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-53e36c2d-3d3c-4f31-8959-c4668ee46efa admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.525558 Jul 20 11:27:32.688523 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 11:27:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 11:27:32.701327 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-a98e9e22-6a7a-423e-8ccf-2893555775bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:32.823398 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-a98e9e22-6a7a-423e-8ccf-2893555775bd admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126531 Jul 20 11:27:32.824185 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jul 20 11:27:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:27:35.065978 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-53e36c2d-3d3c-4f31-8959-c4668ee46efa admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:35.067275 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-53e36c2d-3d3c-4f31-8959-c4668ee46efa admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 Jul 20 11:27:35.067754 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:27:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:35.512513 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-4f88ad89-b032-46f7-8338-774f5591dffd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:35.590593 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-4f88ad89-b032-46f7-8338-774f5591dffd admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.516249 Jul 20 11:27:35.591183 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 11:27:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:27:35.602773 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-1c99e091-8a1e-495c-8444-9f693a7f59d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:35.689690 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-1c99e091-8a1e-495c-8444-9f693a7f59d3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090394 Jul 20 11:27:35.690319 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jul 20 11:27:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:37.925459 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-4f88ad89-b032-46f7-8338-774f5591dffd admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:37.926641 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-4f88ad89-b032-46f7-8338-774f5591dffd admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Jul 20 11:27:37.927407 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:27:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:38.407515 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-ee3fb451-417d-47e4-b1b3-0ee0af9324ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "name": "ds4G", "vcpus": 4, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:38.503708 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-ee3fb451-417d-47e4-b1b3-0ee0af9324ec admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.569705 Jul 20 11:27:38.504516 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 11:27:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:27:38.518087 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-95fc1ae5-27fb-4cdc-898b-f7ef130b48b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:38.611630 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-95fc1ae5-27fb-4cdc-898b-f7ef130b48b2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097345 Jul 20 11:27:38.612466 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jul 20 11:27:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:40.827498 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-ee3fb451-417d-47e4-b1b3-0ee0af9324ec admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:40.828807 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-ee3fb451-417d-47e4-b1b3-0ee0af9324ec admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001865 Jul 20 11:27:40.829386 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:27:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:41.273377 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-a991bfc5-8b9e-417c-9ec4-29d374a505ac admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:41.296014 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-a991bfc5-8b9e-417c-9ec4-29d374a505ac admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.459377 Jul 20 11:27:41.296756 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jul 20 11:27:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:27:43.604601 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-ee3fb451-417d-47e4-b1b3-0ee0af9324ec admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:43.605576 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-ee3fb451-417d-47e4-b1b3-0ee0af9324ec admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 20 11:27:43.605978 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:27:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:44.021976 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-da70f29a-c0d3-4273-86a5-93d86abab2c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "name": "m1.tiny"}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:44.087945 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-da70f29a-c0d3-4273-86a5-93d86abab2c0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.474169 Jul 20 11:27:44.088673 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 11:27:43 2022] POST /compute/v2.1/flavors => generated 402 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:27:44.100639 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-495c9845-6313-4107-a7fa-430f94d99dd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:44.182663 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-495c9845-6313-4107-a7fa-430f94d99dd4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085775 Jul 20 11:27:44.183424 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jul 20 11:27:44 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:46.473435 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-da70f29a-c0d3-4273-86a5-93d86abab2c0 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:46.474437 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-da70f29a-c0d3-4273-86a5-93d86abab2c0 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 20 11:27:46.474840 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:27:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:46.876098 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-c1288441-53c9-43c3-9833-79006eeea799 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048}} {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:46.950114 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-c1288441-53c9-43c3-9833-79006eeea799 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468814 Jul 20 11:27:46.950614 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 11:27:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:27:46.962972 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-d1abba9d-d18e-41ed-b5c7-e59f9bf286f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:47.021963 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-d1abba9d-d18e-41ed-b5c7-e59f9bf286f3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063110 Jul 20 11:27:47.022539 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jul 20 11:27:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:49.270838 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-c1288441-53c9-43c3-9833-79006eeea799 admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:49.271883 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-c1288441-53c9-43c3-9833-79006eeea799 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jul 20 11:27:49.272892 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:27:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:49.670521 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-c2c6726d-fdd9-4d9a-9e82-ef795d03ce91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "disk": 40, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:49.927179 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-c2c6726d-fdd9-4d9a-9e82-ef795d03ce91 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.648714 Jul 20 11:27:49.927739 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 11:27:49 2022] POST /compute/v2.1/flavors => generated 406 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:27:49.940005 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-b722486f-5d27-44d0-b9f0-32b066c0bdfc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:50.022318 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-b722486f-5d27-44d0-b9f0-32b066c0bdfc admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085462 Jul 20 11:27:50.029779 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jul 20 11:27:49 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:27:52.315340 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-c2c6726d-fdd9-4d9a-9e82-ef795d03ce91 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:52.316978 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-c2c6726d-fdd9-4d9a-9e82-ef795d03ce91 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 Jul 20 11:27:52.327921 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:27:52 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:52.784183 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-070a1325-d02b-44e1-8735-3ca9293e225d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4, "ram": 8192, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:52.789087 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG dbcounter [-] [103823] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:52.887886 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-070a1325-d02b-44e1-8735-3ca9293e225d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.559747 Jul 20 11:27:52.887886 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 11:27:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:27:52.897206 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-209a2eb5-34a9-4d97-9c5a-aee71573c42f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:53.001372 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-209a2eb5-34a9-4d97-9c5a-aee71573c42f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107757 Jul 20 11:27:53.002225 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jul 20 11:27:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:55.320284 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-070a1325-d02b-44e1-8735-3ca9293e225d admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:55.322573 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-070a1325-d02b-44e1-8735-3ca9293e225d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002820 Jul 20 11:27:55.323050 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:55.806003 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-9569367a-fdbc-48ff-af2b-18552eec33ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8, "swap": 0, "name": "m1.xlarge"}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:56.572841 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-9569367a-fdbc-48ff-af2b-18552eec33ff admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.243690 Jul 20 11:27:56.583115 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 11:27:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:27:56.591653 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-982d5626-2e88-4149-bc44-4baf66f61bb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:56.691502 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-982d5626-2e88-4149-bc44-4baf66f61bb6 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106198 Jul 20 11:27:56.692490 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jul 20 11:27:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:16.191248 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-9569367a-fdbc-48ff-af2b-18552eec33ff admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:16.192240 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-9569367a-fdbc-48ff-af2b-18552eec33ff admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 20 11:28:16.192627 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:28:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:16.577369 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-5e503628-9552-4f06-8632-9615478f78f7 admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:16.593975 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-5e503628-9552-4f06-8632-9615478f78f7 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395353 Jul 20 11:28:16.594544 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jul 20 11:28:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:28:17.662895 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-9569367a-fdbc-48ff-af2b-18552eec33ff admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:17.663892 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-9569367a-fdbc-48ff-af2b-18552eec33ff admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 20 11:28:17.664286 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 11:28:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:18.178210 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-caf8e125-5590-4655-bc66-ab43daaedf96 admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:18.183787 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.wsgi [None req-caf8e125-5590-4655-bc66-ab43daaedf96 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-caf8e125-5590-4655-bc66-ab43daaedf96 admin admin] Request method failure captured: Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Accept: application/json Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Accept-Encoding: gzip, deflate Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Connection: keep-alive Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Content-Length: 0 Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Host: 10.222.0.43 Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Openstack-Api-Version: compute 2.90 Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Openstack-System-Scope: None Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: User-Agent: python-novaclient Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Auth-Token: gAAAAABi1-bRw2U2rR7xCeUHLARQ3uf8WnAnwpC597MuPTsT3Ml0DU4uYIlUfddH_FOWSMhbXlqpS6yE2d6HCXvdSTACbcJRHJk0qFy1nPHRhAZUpr4iVy2ZUYZPmQ6RyycgfSlv2UZJrfJ2xfaKaMv2o5heI5DgNiHBB1WJ8sEB5bR95zcNYRQ Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Domain-Id: None Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Domain-Name: None Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Identity-Status: Confirmed Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Is-Admin-Project: True Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Project-Domain-Id: default Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Project-Domain-Name: Default Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Project-Id: f42bdd2c624b481e870d88994b304c42 Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Project-Name: admin Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Role: admin,reader,member Jul 20 11:28:18.187001 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Roles: admin,reader,member Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f42bdd2c624b481e870d88994b304c42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f42bdd2c624b481e870d88994b304c42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f42bdd2c624b481e870d88994b304c42", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f42bdd2c624b481e870d88994b304c42"}]}] Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Tenant: admin Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Tenant-Id: f42bdd2c624b481e870d88994b304c42 Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Tenant-Name: admin Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User: admin Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User-Domain-Id: default Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User-Domain-Name: Default Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User-Id: c478678657d042fc82593b8417335c64 Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User-Name: admin Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: method: > Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: exception: Flavor 42 could not be found. Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: action_args: {'id': '42'} Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:28:18.188615 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:18.189557 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:18.190790 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-caf8e125-5590-4655-bc66-ab43daaedf96 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:28:18.192117 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-caf8e125-5590-4655-bc66-ab43daaedf96 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388349 Jul 20 11:28:18.192117 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jul 20 11:28:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 11:28:18.198566 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-f37b18a7-d46e-4314-b6bb-7b537e710876 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:18.201540 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:18.220078 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-f37b18a7-d46e-4314-b6bb-7b537e710876 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025665 Jul 20 11:28:18.220600 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jul 20 11:28:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:28:18.230054 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-04e8e488-6087-42a8-ab7a-08804af3be40 admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:18.250854 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-04e8e488-6087-42a8-ab7a-08804af3be40 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024312 Jul 20 11:28:18.251370 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jul 20 11:28:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:28:18.261662 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-12217f4c-bb47-4bc1-a789-ed5a53aee42c admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:18.267229 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.wsgi [None req-12217f4c-bb47-4bc1-a789-ed5a53aee42c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-12217f4c-bb47-4bc1-a789-ed5a53aee42c admin admin] Request method failure captured: Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Accept: application/json Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Accept-Encoding: gzip, deflate Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Connection: keep-alive Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Content-Length: 0 Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Host: 10.222.0.43 Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Openstack-Api-Version: compute 2.90 Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Openstack-System-Scope: None Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: User-Agent: python-novaclient Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Auth-Token: gAAAAABi1-bRw2U2rR7xCeUHLARQ3uf8WnAnwpC597MuPTsT3Ml0DU4uYIlUfddH_FOWSMhbXlqpS6yE2d6HCXvdSTACbcJRHJk0qFy1nPHRhAZUpr4iVy2ZUYZPmQ6RyycgfSlv2UZJrfJ2xfaKaMv2o5heI5DgNiHBB1WJ8sEB5bR95zcNYRQ Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Domain-Id: None Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Domain-Name: None Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Identity-Status: Confirmed Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Is-Admin-Project: True Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Project-Domain-Id: default Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Project-Domain-Name: Default Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Project-Id: f42bdd2c624b481e870d88994b304c42 Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Project-Name: admin Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Role: admin,reader,member Jul 20 11:28:18.270453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Roles: admin,reader,member Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f42bdd2c624b481e870d88994b304c42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f42bdd2c624b481e870d88994b304c42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f42bdd2c624b481e870d88994b304c42", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f42bdd2c624b481e870d88994b304c42"}]}] Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Tenant: admin Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Tenant-Id: f42bdd2c624b481e870d88994b304c42 Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Tenant-Name: admin Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User: admin Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User-Domain-Id: default Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User-Domain-Name: Default Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User-Id: c478678657d042fc82593b8417335c64 Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User-Name: admin Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: method: > Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: exception: Flavor 42 could not be found. Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: action_args: {'id': '42'} Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:28:18.271831 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:18.285072 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:18.286362 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-12217f4c-bb47-4bc1-a789-ed5a53aee42c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:28:18.287468 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-12217f4c-bb47-4bc1-a789-ed5a53aee42c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014628 Jul 20 11:28:18.287468 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jul 20 11:28:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 11:28:19.250216 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-04e8e488-6087-42a8-ab7a-08804af3be40 admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:19.251272 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-04e8e488-6087-42a8-ab7a-08804af3be40 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 20 11:28:19.251662 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 11:28:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:28:19.766318 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-c8c179c8-fc2a-49de-ae8a-baa99fc21673 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:19.771616 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.wsgi [None req-c8c179c8-fc2a-49de-ae8a-baa99fc21673 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-c8c179c8-fc2a-49de-ae8a-baa99fc21673 admin admin] Request method failure captured: Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Accept: application/json Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Accept-Encoding: gzip, deflate Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Connection: keep-alive Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Content-Length: 0 Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Host: 10.222.0.43 Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Openstack-Api-Version: compute 2.90 Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Openstack-System-Scope: None Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: User-Agent: python-novaclient Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Auth-Token: gAAAAABi1-bT83Tsf2AGammWxUZecTGX7oMcVeG8mZ8Z-aRYrxRDxF7ERlGO1TI03KS8zgsjxNp3VbATJF8jeZyHLG5U8kwJIbYgkPmDcmoFoBFdM2a-PthlOdMlwQ7NByC8gdXtNRLe5xUZyJhHoX5A9nfWF87Kht2jev4meXnnp-zgoGDVbno Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Domain-Id: None Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Domain-Name: None Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Identity-Status: Confirmed Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Is-Admin-Project: True Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Project-Domain-Id: default Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Project-Domain-Name: Default Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Project-Id: f42bdd2c624b481e870d88994b304c42 Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Project-Name: admin Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Role: admin,reader,member Jul 20 11:28:19.773996 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Roles: admin,reader,member Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f42bdd2c624b481e870d88994b304c42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f42bdd2c624b481e870d88994b304c42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f42bdd2c624b481e870d88994b304c42", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f42bdd2c624b481e870d88994b304c42"}]}] Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Tenant: admin Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Tenant-Id: f42bdd2c624b481e870d88994b304c42 Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Tenant-Name: admin Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User: admin Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User-Domain-Id: default Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User-Domain-Name: Default Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User-Id: c478678657d042fc82593b8417335c64 Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User-Name: admin Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: method: > Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: exception: Flavor 84 could not be found. Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: action_args: {'id': '84'} Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:28:19.775553 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:19.776342 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:19.777692 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-c8c179c8-fc2a-49de-ae8a-baa99fc21673 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:28:19.779261 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-c8c179c8-fc2a-49de-ae8a-baa99fc21673 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.386312 Jul 20 11:28:19.779261 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jul 20 11:28:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 11:28:19.784221 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-ec462021-b88c-4d18-9036-554ec6e46164 admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:19.798512 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-ec462021-b88c-4d18-9036-554ec6e46164 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017857 Jul 20 11:28:19.799040 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jul 20 11:28:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:28:19.808836 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-88f284f6-69ed-44b1-a694-11c990097560 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:19.822038 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-88f284f6-69ed-44b1-a694-11c990097560 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017124 Jul 20 11:28:19.822542 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jul 20 11:28:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:28:19.831302 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-bb9e945c-ac34-4775-8ce4-1a6372a7c598 admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:19.836498 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.wsgi [None req-bb9e945c-ac34-4775-8ce4-1a6372a7c598 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-bb9e945c-ac34-4775-8ce4-1a6372a7c598 admin admin] Request method failure captured: Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Accept: application/json Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Accept-Encoding: gzip, deflate Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Connection: keep-alive Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Content-Length: 0 Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Host: 10.222.0.43 Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Openstack-Api-Version: compute 2.90 Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Openstack-System-Scope: None Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: User-Agent: python-novaclient Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Auth-Token: gAAAAABi1-bT83Tsf2AGammWxUZecTGX7oMcVeG8mZ8Z-aRYrxRDxF7ERlGO1TI03KS8zgsjxNp3VbATJF8jeZyHLG5U8kwJIbYgkPmDcmoFoBFdM2a-PthlOdMlwQ7NByC8gdXtNRLe5xUZyJhHoX5A9nfWF87Kht2jev4meXnnp-zgoGDVbno Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Domain-Id: None Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Domain-Name: None Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Identity-Status: Confirmed Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Is-Admin-Project: True Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Project-Domain-Id: default Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Project-Domain-Name: Default Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Project-Id: f42bdd2c624b481e870d88994b304c42 Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Project-Name: admin Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Role: admin,reader,member Jul 20 11:28:19.838017 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Roles: admin,reader,member Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f42bdd2c624b481e870d88994b304c42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f42bdd2c624b481e870d88994b304c42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f42bdd2c624b481e870d88994b304c42", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f42bdd2c624b481e870d88994b304c42"}]}] Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Tenant: admin Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Tenant-Id: f42bdd2c624b481e870d88994b304c42 Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Tenant-Name: admin Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User: admin Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User-Domain-Id: default Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User-Domain-Name: Default Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User-Id: c478678657d042fc82593b8417335c64 Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User-Name: admin Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: method: > Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: exception: Flavor 84 could not be found. Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: action_args: {'id': '84'} Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:28:19.839556 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:19.840678 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:19.842002 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-bb9e945c-ac34-4775-8ce4-1a6372a7c598 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:28:19.843324 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-bb9e945c-ac34-4775-8ce4-1a6372a7c598 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011426 Jul 20 11:28:19.843324 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jul 20 11:28:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 11:28:20.802676 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-88f284f6-69ed-44b1-a694-11c990097560 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:20.803696 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-88f284f6-69ed-44b1-a694-11c990097560 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 20 11:28:20.804133 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 11:28:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:21.321019 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-705f7aec-5653-4cf5-9d17-9988833060c3 admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:21.326849 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.wsgi [None req-705f7aec-5653-4cf5-9d17-9988833060c3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-705f7aec-5653-4cf5-9d17-9988833060c3 admin admin] Request method failure captured: Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Accept: application/json Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Accept-Encoding: gzip, deflate Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Connection: keep-alive Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Content-Length: 0 Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Host: 10.222.0.43 Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Openstack-Api-Version: compute 2.90 Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Openstack-System-Scope: None Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: User-Agent: python-novaclient Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Auth-Token: gAAAAABi1-bUBqxLeIPLUhPlz3Y7SjB6UeBeCEkPZYSbWee2uJdhS_cwcFXyyfNruUuGqCcdokdov4oBvlcEVL4Ahv9X76--Ikdu4o1U-5Wb7h3QHIAnlp6OYCPNDvcn0pA2iWI75m3YBUnjgCE0mQ_JQMn2DiHMuiI5rF8WzPo7Rp_sE2aEPt0 Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Domain-Id: None Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Domain-Name: None Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Identity-Status: Confirmed Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Is-Admin-Project: True Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Project-Domain-Id: default Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Project-Domain-Name: Default Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Project-Id: f42bdd2c624b481e870d88994b304c42 Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Project-Name: admin Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Role: admin,reader,member Jul 20 11:28:21.328364 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Roles: admin,reader,member Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f42bdd2c624b481e870d88994b304c42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f42bdd2c624b481e870d88994b304c42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f42bdd2c624b481e870d88994b304c42", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f42bdd2c624b481e870d88994b304c42"}]}] Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Tenant: admin Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Tenant-Id: f42bdd2c624b481e870d88994b304c42 Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-Tenant-Name: admin Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User: admin Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User-Domain-Id: default Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User-Domain-Name: Default Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User-Id: c478678657d042fc82593b8417335c64 Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: X-User-Name: admin Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: method: > Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: exception: Flavor 451 could not be found. Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: action_args: {'id': '451'} Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:28:21.329922 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:21.330902 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: ERROR nova.api.openstack.wsgi Jul 20 11:28:21.332025 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-705f7aec-5653-4cf5-9d17-9988833060c3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:28:21.333073 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-705f7aec-5653-4cf5-9d17-9988833060c3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.387637 Jul 20 11:28:21.333073 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jul 20 11:28:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 11:28:21.339324 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-8198913a-568c-40ae-b3a7-5f87850753ff admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:21.353131 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-8198913a-568c-40ae-b3a7-5f87850753ff admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017249 Jul 20 11:28:21.353650 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jul 20 11:28:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:28:21.362775 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:21.378012 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018661 Jul 20 11:28:21.378532 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jul 20 11:28:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:28:21.388431 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-978094d4-a6a6-46ae-a635-2177678d7002 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:21.393666 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.wsgi [None req-978094d4-a6a6-46ae-a635-2177678d7002 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-978094d4-a6a6-46ae-a635-2177678d7002 admin admin] Request method failure captured: Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Accept: application/json Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Accept-Encoding: gzip, deflate Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Connection: keep-alive Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Content-Length: 0 Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Host: 10.222.0.43 Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Openstack-Api-Version: compute 2.90 Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Openstack-System-Scope: None Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: User-Agent: python-novaclient Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Auth-Token: gAAAAABi1-bUBqxLeIPLUhPlz3Y7SjB6UeBeCEkPZYSbWee2uJdhS_cwcFXyyfNruUuGqCcdokdov4oBvlcEVL4Ahv9X76--Ikdu4o1U-5Wb7h3QHIAnlp6OYCPNDvcn0pA2iWI75m3YBUnjgCE0mQ_JQMn2DiHMuiI5rF8WzPo7Rp_sE2aEPt0 Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Domain-Id: None Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Domain-Name: None Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Identity-Status: Confirmed Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Is-Admin-Project: True Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Project-Domain-Id: default Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Project-Domain-Name: Default Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Project-Id: f42bdd2c624b481e870d88994b304c42 Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Project-Name: admin Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Role: admin,reader,member Jul 20 11:28:21.395152 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Roles: admin,reader,member Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f42bdd2c624b481e870d88994b304c42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f42bdd2c624b481e870d88994b304c42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f42bdd2c624b481e870d88994b304c42", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f42bdd2c624b481e870d88994b304c42"}]}] Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Tenant: admin Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Tenant-Id: f42bdd2c624b481e870d88994b304c42 Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-Tenant-Name: admin Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User: admin Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User-Domain-Id: default Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User-Domain-Name: Default Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User-Id: c478678657d042fc82593b8417335c64 Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: X-User-Name: admin Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: method: > Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: exception: Flavor 451 could not be found. Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: action_args: {'id': '451'} Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:28:21.396698 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:21.397642 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: ERROR nova.api.openstack.wsgi Jul 20 11:28:21.398772 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-978094d4-a6a6-46ae-a635-2177678d7002 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:28:21.400115 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-978094d4-a6a6-46ae-a635-2177678d7002 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011477 Jul 20 11:28:21.400115 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jul 20 11:28:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 11:28:22.373502 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:22.374552 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 20 11:28:22.374938 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 11:28:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:23.023487 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-98058cb7-f486-42dd-827c-f06af0edc14f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:23.108972 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-98058cb7-f486-42dd-827c-f06af0edc14f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.596948 Jul 20 11:28:23.109441 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jul 20 11:28:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:28:24.083183 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:24.084176 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 20 11:28:24.084563 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 11:28:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:24.609141 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-da5bd347-e267-4a5a-be1b-9ca6870abc69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:24.713207 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-da5bd347-e267-4a5a-be1b-9ca6870abc69 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.483891 Jul 20 11:28:24.713767 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jul 20 11:28:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:28:25.675471 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:25.676502 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 20 11:28:25.676915 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 11:28:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:26.204014 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-de20c8f5-e8a9-4cd0-b784-0dad02e4a8d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:26.262695 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-de20c8f5-e8a9-4cd0-b784-0dad02e4a8d4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.448056 Jul 20 11:28:26.263233 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jul 20 11:28:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 11:28:27.244182 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:27.245231 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 20 11:28:27.245625 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 11:28:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:27.768635 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-87ad21e4-6549-4fe1-8879-cd02fedc2ce2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:27.863496 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-87ad21e4-6549-4fe1-8879-cd02fedc2ce2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.482963 Jul 20 11:28:27.863953 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jul 20 11:28:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 11:28:28.835912 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:28.837501 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002011 Jul 20 11:28:28.837897 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 11:28:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:29.358573 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-24585e3f-bae1-4815-a490-9e74b843317c admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:29.377150 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-24585e3f-bae1-4815-a490-9e74b843317c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403440 Jul 20 11:28:29.377685 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Wed Jul 20 11:28:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:29:21.106863 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:21.107853 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-e5cb6b66-b82d-4637-985d-c494f567bfbb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jul 20 11:29:21.108239 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 11:29:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:29:21.118388 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:21.498630 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-4e24eabe-a72c-4ad3-a039-34e464664533 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:21.518018 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-4e24eabe-a72c-4ad3-a039-34e464664533 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404054 Jul 20 11:29:21.518537 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jul 20 11:29:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:29:21.538944 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG dbcounter [-] [103823] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:21.542632 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-8694ad61-8f2c-405d-a6d4-477bdedd9533 admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:21.550051 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-8694ad61-8f2c-405d-a6d4-477bdedd9533 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012490 Jul 20 11:29:21.550622 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1282 bytes} [Wed Jul 20 11:29:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:21.562495 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-7173615b-ba21-49e1-9502-2e1f94e73d20 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:21.569980 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-7173615b-ba21-49e1-9502-2e1f94e73d20 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011561 Jul 20 11:29:21.570480 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1285 bytes} [Wed Jul 20 11:29:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:21.582190 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-3f92bfc1-613c-4b62-9d38-1e73f83bffff admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:21.589966 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-3f92bfc1-613c-4b62-9d38-1e73f83bffff admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011258 Jul 20 11:29:21.590474 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1285 bytes} [Wed Jul 20 11:29:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:21.601384 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-787316b4-53f1-487f-b44b-c8f6e27a8261 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:21.608838 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-787316b4-53f1-487f-b44b-c8f6e27a8261 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010919 Jul 20 11:29:21.609343 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1282 bytes} [Wed Jul 20 11:29:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:33:12.488509 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-3f92bfc1-613c-4b62-9d38-1e73f83bffff admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:12.489560 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-3f92bfc1-613c-4b62-9d38-1e73f83bffff admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 20 11:33:12.489952 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 11:33:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:12.631255 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writing DB stats nova_api:SELECT=6 {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:12.772262 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-f56cbd04-8d8d-4ce2-8949-33b28ef9aec3 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:12.773473 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:33:12.773473 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: warnings.warn(msg) Jul 20 11:33:12.774684 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-f56cbd04-8d8d-4ce2-8949-33b28ef9aec3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:12.775112 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-f56cbd04-8d8d-4ce2-8949-33b28ef9aec3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:12.775883 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-f56cbd04-8d8d-4ce2-8949-33b28ef9aec3 admin admin] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:12.776302 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-f56cbd04-8d8d-4ce2-8949-33b28ef9aec3 admin admin] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:12.810747 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-f56cbd04-8d8d-4ce2-8949-33b28ef9aec3 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.180869 Jul 20 11:33:12.811289 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jul 20 11:33:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:33:13.654158 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-3f92bfc1-613c-4b62-9d38-1e73f83bffff admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:13.655157 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-3f92bfc1-613c-4b62-9d38-1e73f83bffff admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jul 20 11:33:13.655549 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 11:33:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:13.846147 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-ceef3f06-c179-4248-975e-747a2b794a52 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:13.847311 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:33:13.847311 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: warnings.warn(msg) Jul 20 11:33:13.848488 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-ceef3f06-c179-4248-975e-747a2b794a52 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:13.848959 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-ceef3f06-c179-4248-975e-747a2b794a52 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:13.849749 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-ceef3f06-c179-4248-975e-747a2b794a52 admin admin] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:13.850175 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-ceef3f06-c179-4248-975e-747a2b794a52 admin admin] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:13.869866 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-ceef3f06-c179-4248-975e-747a2b794a52 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074345 Jul 20 11:33:13.870421 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jul 20 11:33:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:33:25.126082 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-3f92bfc1-613c-4b62-9d38-1e73f83bffff admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:25.127082 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-3f92bfc1-613c-4b62-9d38-1e73f83bffff admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 Jul 20 11:33:25.127475 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 11:33:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:25.279550 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writing DB stats nova_cell0:SELECT=4 {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:25.280262 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writing DB stats nova_cell1:SELECT=4 {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:25.280887 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG dbcounter [-] [103824] Writing DB stats nova_api:SELECT=8 {{(pid=103824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:25.330259 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-1d20c3a8-84bd-45f5-b023-9fe95e72d64f admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:25.331453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:33:25.331453 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: warnings.warn(msg) Jul 20 11:33:25.332948 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-1d20c3a8-84bd-45f5-b023-9fe95e72d64f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:25.333393 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-1d20c3a8-84bd-45f5-b023-9fe95e72d64f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:25.334256 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-1d20c3a8-84bd-45f5-b023-9fe95e72d64f admin admin] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:25.334641 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-1d20c3a8-84bd-45f5-b023-9fe95e72d64f admin admin] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:25.361954 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-1d20c3a8-84bd-45f5-b023-9fe95e72d64f admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086528 Jul 20 11:33:25.362595 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jul 20 11:33:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:33:26.182907 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: DEBUG nova.api.openstack.wsgi [None req-3f92bfc1-613c-4b62-9d38-1e73f83bffff admin admin] Calling method '>' {{(pid=103823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:26.183907 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: INFO nova.api.openstack.requestlog [None req-3f92bfc1-613c-4b62-9d38-1e73f83bffff admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jul 20 11:33:26.184303 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: [pid: 103823|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 11:33:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:26.374791 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG nova.api.openstack.wsgi [None req-d459940a-2468-493e-a46f-ec58939f3296 admin admin] Calling method '>' {{(pid=103824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:26.375970 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:33:26.375970 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: warnings.warn(msg) Jul 20 11:33:26.377182 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-d459940a-2468-493e-a46f-ec58939f3296 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:26.377622 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-d459940a-2468-493e-a46f-ec58939f3296 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:26.378431 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-d459940a-2468-493e-a46f-ec58939f3296 admin admin] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:26.378856 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: DEBUG oslo_concurrency.lockutils [None req-d459940a-2468-493e-a46f-ec58939f3296 admin admin] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:26.400241 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: INFO nova.api.openstack.requestlog [None req-d459940a-2468-493e-a46f-ec58939f3296 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078171 Jul 20 11:33:26.400711 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: [pid: 103824|app: 0|req: 39/76] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jul 20 11:33:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:34:24.395104 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: Wed Jul 20 11:34:24 2022 - graceful shutdown triggered... Jul 20 11:34:24.394851 dv-cinder-822822-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 11:34:24.396057 dv-cinder-822822-4-iscsi devstack@n-api.service[103823]: Gracefully killing worker 1 (pid: 103823)... Jul 20 11:34:24.396666 dv-cinder-822822-4-iscsi devstack@n-api.service[103824]: Gracefully killing worker 2 (pid: 103824)... Jul 20 11:34:25.395894 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: worker 1 buried after 1 seconds Jul 20 11:34:25.395894 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: worker 2 buried after 1 seconds Jul 20 11:34:25.395894 dv-cinder-822822-4-iscsi devstack@n-api.service[103822]: goodbye to uWSGI. Jul 20 11:34:25.397511 dv-cinder-822822-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 20 11:34:25.398054 dv-cinder-822822-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 11:34:25.401387 dv-cinder-822822-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 11:34:25 2022] *** Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: nodename: dv-cinder-822822-4-iscsi Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: machine: x86_64 Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: clock source: unix Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: pcre jit disabled Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: detected number of CPU cores: 4 Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: current working directory: / Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: detected binary path: /usr/bin/uwsgi-core Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: your processes number limit is 47680 Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: your memory page size is 4096 bytes Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: detected max file descriptor number: 2048 Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: lock engine: pthread robust mutexes Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: thunder lock: enabled Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 11:34:25.416267 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 11:34:25.460055 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: Python main interpreter initialized at 0x55717b7709c0 Jul 20 11:34:25.460055 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: python threads support enabled Jul 20 11:34:25.460055 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: your server socket listen backlog is limited to 100 connections Jul 20 11:34:25.460055 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: your mercy for graceful operations on workers is 90 seconds Jul 20 11:34:25.460513 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 11:34:25.460513 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: *** Operational MODE: preforking *** Jul 20 11:34:25.460896 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: *** uWSGI is running in multiple interpreter mode *** Jul 20 11:34:25.460896 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: spawned uWSGI master process (pid: 124814) Jul 20 11:34:25.461024 dv-cinder-822822-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 11:34:25.461592 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: spawned uWSGI worker 1 (pid: 124830, cores: 1) Jul 20 11:34:25.461936 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: spawned uWSGI worker 2 (pid: 124831, cores: 1) Jul 20 11:34:25.462082 dv-cinder-822822-4-iscsi devstack@n-api.service[124814]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 11:34:26.125925 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 11:34:26.129228 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 11:34:27.327059 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 11:34:27.327059 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: from cryptography.utils import int_from_bytes Jul 20 11:34:27.327811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 11:34:27.327811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: from cryptography.utils import int_from_bytes Jul 20 11:34:27.331819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 11:34:27.331819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: from cryptography.utils import int_from_bytes Jul 20 11:34:27.332347 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 11:34:27.332347 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: from cryptography.utils import int_from_bytes Jul 20 11:34:29.612353 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 11:34:29.613011 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 11:34:29.613124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 11:34:29.613481 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 11:34:29.613736 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 11:34:29.614121 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.614445 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.614768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.615109 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.615458 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.615769 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.616087 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.616405 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.616729 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.617014 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.617327 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.617654 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-4-iscsi {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.617971 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.618273 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.618580 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.618894 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.619196 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.619512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.619816 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.620306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.621571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.621571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.621571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.621836 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 11:34:29.622213 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.622325 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 11:34:29.622405 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.622489 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 11:34:29.622564 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.622564 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.622737 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 11:34:29.622825 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 11:34:29.622905 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.623208 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.623314 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.623488 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.623655 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.623823 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.623957 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-4-iscsi {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.624141 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.624245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.624475 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.624623 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.624869 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.624986 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.625143 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.625235 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.625457 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.625618 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.625782 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.625885 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.626095 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.626208 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.626344 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.626452 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.627250 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-4-iscsi {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.627408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.627570 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.627729 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.627886 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.628046 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.628200 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.628354 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.628502 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.628672 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.628862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.629024 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.629180 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.629336 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.629484 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.629644 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.629644 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.629937 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.630101 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.630264 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.631639 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.633015 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.633192 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.633352 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.633455 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.633558 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.633667 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.633764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.633852 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.633938 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.634034 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.634184 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.634285 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.634285 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.634508 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.634603 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.634702 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.634803 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.634893 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.635036 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.635036 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.635207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-4-iscsi {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.635521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.635521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.635521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.635521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.635521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.635521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.635521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.636260 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.636364 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.636364 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.636364 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.636604 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.636700 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.636811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.636902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.637005 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.637232 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.637572 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.637887 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.638142 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.638247 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.638483 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.638579 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.638796 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.638898 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.639101 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.639196 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.639405 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.639546 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.639708 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.639805 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.640027 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.640121 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.640359 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.640454 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.640658 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.640905 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.641056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.641159 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.641257 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.641427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.641525 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.641655 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.641806 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.641972 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.642109 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.642296 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.642414 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.642606 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.642708 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.642916 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.643018 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.643169 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.643273 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.643477 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.643580 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.643802 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.643902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.644125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.644229 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.644437 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.644534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.644692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.644816 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.644957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.645074 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.645280 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.645410 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.645837 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.646000 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.646102 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.646199 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.646295 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.646892 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.647038 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.647136 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.647341 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.647448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.647643 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.647738 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.647945 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.648049 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.648267 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.648371 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.648569 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.648672 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.648903 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.649004 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.649222 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.649337 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.649521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.649661 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.649821 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.649925 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.650134 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.650240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.650437 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.650539 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.650739 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.650835 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.651054 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.651151 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.651351 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.651461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.651655 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.651762 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.651966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.652071 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.652267 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.652364 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.652568 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.652672 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.652901 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.653004 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.653189 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.653287 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.653488 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.653593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.653787 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.653883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.654083 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.654177 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.654458 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.654577 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.654673 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.654761 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.654946 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.655049 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.655252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.655356 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.655570 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.655743 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.655871 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.655975 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.656170 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.656275 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.656474 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.656575 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.656775 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.656896 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.657143 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.657257 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.657410 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.657505 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.658461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.658611 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.658728 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.658853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.658978 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.659102 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.659224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.659350 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.659481 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.659604 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.659727 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.659853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.659969 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.660083 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.660205 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.660328 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.660443 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.660564 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.660679 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.660826 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.660967 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.661085 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.661209 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.661324 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.661446 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.661568 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.661690 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.661815 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.661930 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.662774 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.662896 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.664818 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.664946 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.664946 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.665124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.665208 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.665289 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.665364 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.665441 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.665515 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.665600 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.665674 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.665779 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.665872 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.665977 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.666056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.666141 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.666216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.666288 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.666366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.666448 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.666523 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.666603 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.666683 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.666766 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.666840 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.666912 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.666996 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.667106 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.667532 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.667641 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.667718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.667797 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.667880 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.668062 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.668159 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.668356 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.668526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.668685 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.668863 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.668980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.669065 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.669289 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.669398 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.669597 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.669707 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.669907 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.670020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.670224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 11:34:29.670429 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.670519 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.670608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.670840 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.670951 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.671149 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.671259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.671468 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.671568 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.671774 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.671895 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.672081 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.672189 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.672389 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.672511 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.672690 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.672825 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.673022 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.673122 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.673328 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.673473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.673640 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.673736 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.674024 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.674136 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.674284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.674391 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.674796 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.674901 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.674990 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.675066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.675154 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.675237 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.675516 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.675629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.675785 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.675880 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.676062 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.676169 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.676368 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.676475 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.676669 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.676872 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.677067 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.677217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.677375 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.677564 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.677758 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.677907 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.678067 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.678242 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.678407 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.678557 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.678711 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.678873 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.679029 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.679183 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.679347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.679494 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.679667 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.680002 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.680164 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.680312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.680479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.680636 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.680806 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.681057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.681229 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.681452 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.681603 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.681769 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.681924 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.682080 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.682227 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.682380 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.682527 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.682672 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.682834 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.683524 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.683682 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.683829 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.684000 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.684281 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.684461 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.684617 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.685014 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.685274 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.685434 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.686187 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.686364 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.686515 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.686670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.686824 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.686980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.687133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.687310 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.687470 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.687617 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.687763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.687916 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.688145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.688328 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.688490 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.688637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.688801 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.688964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.689126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.689289 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.689453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.689624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.689779 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.689925 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.690173 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.690324 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.690471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.690617 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.690617 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.691571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.691737 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.691959 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.692123 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.692282 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.692437 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.692593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.692593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.692970 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.693130 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.693773 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.693921 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.694076 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.694251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.694524 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.694678 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.694849 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.695078 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.695262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.695491 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.695645 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.695799 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.695955 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.696128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.696371 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.696529 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.696684 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.696849 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.697001 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.697165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.697429 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.697591 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.697747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.697893 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.698057 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.698313 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.698479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.698638 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.698794 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.698947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.699108 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.699267 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.699413 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.699576 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.699722 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.699869 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.700022 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.700383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.700537 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.700684 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.700847 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.700999 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.701155 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.701976 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.702204 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.702369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.702525 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.702680 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.702835 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.702983 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.703128 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.703284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.703439 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.703595 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.703755 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.703909 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.704057 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.704202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.704365 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.704653 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.704853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.705014 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.705256 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.705416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.705656 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.705809 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.705964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.706111 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.706540 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.706705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.706853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.707024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.707173 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.707328 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.707582 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.707742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.707889 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.708048 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.708196 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.708361 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.708508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.708653 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.708825 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.709538 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.709714 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.709875 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.710037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.710190 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.710435 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.710604 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.710758 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.710910 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.711069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.711261 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.711435 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.711675 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.711840 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.712012 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.712195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.712415 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.712594 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.712750 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.712926 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.713079 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.713362 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.713565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.713746 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.713907 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.714060 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.714224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.714375 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.714375 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.714808 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.714968 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.715166 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.715459 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.715648 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.715902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.716077 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.716240 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.716427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.716682 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.716893 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.717062 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.717217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.717369 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.717529 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.717794 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.717961 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.718127 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.718295 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.718459 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.718613 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.718767 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.718926 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.719101 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.719256 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.719452 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.719616 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.719771 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.719930 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.720092 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.720244 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.720414 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.720643 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.720848 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.721024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.721177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.721340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.721500 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.721680 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.721914 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.722087 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.722240 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.722410 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.722639 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.722797 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.722957 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.723119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.723283 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.723435 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.723604 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.723756 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.723914 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.724078 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.724230 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.724388 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.724569 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.724923 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.725108 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.725274 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.725454 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.725689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.725875 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.726102 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.726268 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.726420 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.726572 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.726821 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.726980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.727170 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.727170 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.727475 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.727627 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.727907 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.728069 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.728244 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.728411 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.728564 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.728715 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.728902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.729063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.729225 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.729385 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.729537 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.729689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.729848 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.730000 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.730161 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.730327 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.730488 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.730657 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.730888 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.731206 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.731367 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.731519 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.731678 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.731839 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.732076 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.732243 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.732397 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.732585 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.732929 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.733100 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.733254 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.733415 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.733569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.733731 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.733898 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.734052 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.734203 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.734363 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.734523 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.734688 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.734854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.735147 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.735307 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.735468 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.735631 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.735884 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.735884 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.736274 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.736440 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.736596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.736748 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.737025 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.737197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.737351 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.737514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.737668 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.737821 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.738006 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.738257 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.738419 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.738572 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.738735 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.738897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.739065 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.739065 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.739368 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.739532 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.739695 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.739928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.740108 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.740267 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.740420 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.740580 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.740734 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.740942 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.741167 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.741326 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.741491 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.741651 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.741806 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.741969 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.742209 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.742209 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.742516 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.742676 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.742676 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.743063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.743220 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.743372 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.743530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.743694 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.743857 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.744011 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.744164 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.744323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.744476 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.744636 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.744852 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.745015 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.745312 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.745471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.745624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.745785 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.746042 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.746209 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.746449 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.746684 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.746848 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.747030 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.747273 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.747431 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.747591 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.747755 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.747915 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.748069 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.748249 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.748503 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.748662 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.748851 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.749020 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.749175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.749328 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.749480 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.749642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.749805 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.749959 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.750119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.750274 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.750437 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.750604 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.750758 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.750919 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.751082 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.751320 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.751487 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.751651 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.751811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.751965 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.752116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.752366 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.752534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.752709 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.752908 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.753080 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.753313 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.753480 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.753634 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.753802 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.753957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.754110 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.754110 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.754409 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.754576 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.754738 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.754901 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.755054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.755346 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.755521 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.756207 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.756464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.756697 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.756876 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.757042 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.757461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.757714 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.757882 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.758036 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.758200 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.758353 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.758524 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.758784 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.758951 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.759105 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.759258 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.759411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.759573 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.759736 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.759890 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.760043 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.760206 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.760367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.760530 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.760693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.760907 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.761066 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.761219 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.761455 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.761632 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.761800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.761954 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.762107 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.762258 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.762508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.762681 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.762837 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.762997 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.763149 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.763327 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.763563 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.763722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.763877 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.764028 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.764191 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.764345 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.764345 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.764655 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.764836 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.764996 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.765147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.765310 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.765616 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.765771 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.765932 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.766093 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.766245 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.766421 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.766678 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.766906 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.767076 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.767238 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.767391 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.767559 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.767731 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.767971 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.768139 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.768301 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.768462 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.768640 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.768839 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.769096 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.769255 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.769430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.769584 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.769747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.769900 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.770053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.770207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.770360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.770567 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.770729 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.770883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.771035 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.771197 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.772130 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.772308 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.772489 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.772722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.772916 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.773071 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.773223 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.773387 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.773561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.773790 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.773955 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.774108 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.774270 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.774445 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.774606 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.774767 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.774921 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.775080 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.775242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.775410 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.775710 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.775865 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.776018 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.776178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.776347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.776502 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.776695 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.777026 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.777187 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.777339 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.777513 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.777675 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.777829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.778008 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.778256 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.778414 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.778589 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.778754 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.778915 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.779099 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.779349 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.779515 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.779684 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.779837 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.780112 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.780285 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.780449 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.780689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.780866 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.781025 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.781188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.781342 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.781518 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.781687 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.781841 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.782001 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.782174 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.782404 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.782569 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.782751 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.782991 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.783150 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.783311 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.783505 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.783674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.783926 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.784085 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.784246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.784407 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.784559 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.784720 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.784913 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.785071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.785232 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.785394 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.785705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.785883 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.786057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.786226 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.786381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.786542 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.786696 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.786857 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.788140 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.788509 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.788676 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.788901 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.789064 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.789413 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.789689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.789871 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.790028 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.790182 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.790342 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.790512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.790674 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.790829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.790989 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.791190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.791360 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.791515 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.791668 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.791840 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.792001 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.792165 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.792334 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.792575 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.792736 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.792736 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.793168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.793335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.793504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.793659 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.793812 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.794061 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.794242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.794408 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.794570 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.794724 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.794877 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.795037 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.795191 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.795404 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.795562 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.795864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.796027 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.796189 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.796352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.796531 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.796694 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.796866 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.797024 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.797024 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.797329 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.797492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.798696 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.798875 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.799031 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.799204 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.799204 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.799204 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.799689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.799940 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.800107 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.800276 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.800438 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.800593 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.800746 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.800939 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.800939 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.801243 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.801243 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.801546 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.801709 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.801871 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.802037 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.802198 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.802198 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.802504 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.802504 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.802916 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.802916 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.803311 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.803478 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.803632 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.803786 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.803962 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.804755 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.804943 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.805099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.805199 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.805289 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.805376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.805476 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.805573 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.805668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.805758 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.806029 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.806165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.806289 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.806403 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.806517 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.806638 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.806752 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.806949 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.807076 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.807200 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.807316 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.807429 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.807558 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.807683 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.807805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.807921 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.808035 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.808147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.808267 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.808398 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.808536 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.808536 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.809459 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.809589 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.809720 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.809849 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.809990 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.810209 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.810328 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.810442 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.810763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.810894 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.811011 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.811126 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.811246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.811361 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.811484 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.811598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.811719 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.811833 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.811945 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.812067 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.812192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.812307 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.812420 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.812541 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.812655 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.812897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.813047 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.813165 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.813305 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.813498 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.813693 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.813826 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.813942 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.814055 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.814176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.814298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.814412 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.814534 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.814649 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.814855 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.814977 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.815092 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.815205 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.815332 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.815454 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.815568 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.815687 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.815811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.816064 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.816195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.816310 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.816423 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.816535 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.816648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.816770 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.816972 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.817103 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.817216 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.817329 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.817450 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.817573 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.817687 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.817800 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.817800 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.818019 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.818140 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.818985 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.819118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.819241 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.819484 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.819604 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.819727 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.819843 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.819964 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.820079 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.820211 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.820433 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.820689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.820887 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.820887 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.821209 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.821377 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.821546 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.821711 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.821867 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.822026 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.822180 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.822333 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.822495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.822658 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.822820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.822820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.823221 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.823384 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.823648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.823810 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.823963 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.824116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.824276 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.824429 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.824592 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.824746 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.825011 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.825183 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.825337 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.825499 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.825673 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.825828 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.825980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.826278 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.826439 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.826852 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.827601 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.827767 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.827922 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.828075 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.828229 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.828395 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.828571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.828571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.829097 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.829097 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.829097 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.829097 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.829097 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.829948 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.830111 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.830272 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.830459 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.830723 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.830957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.831135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.831290 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.831451 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.831614 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.831775 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.831945 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.832100 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.832261 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.832414 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.832575 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.832729 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.832947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.833197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.833771 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.834491 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.834653 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.834816 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.834972 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.835136 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.835290 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.835443 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.835596 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.835596 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.835913 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.836078 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.836381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.836542 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.836696 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.836935 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.837101 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.837271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.837425 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.837578 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.837737 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.837904 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.838135 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.838318 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.838473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.838625 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.838784 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.838949 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.839273 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.839436 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.839589 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.839842 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.840010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.840166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.840328 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.840328 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.840643 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.840945 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.841180 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.841355 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.841511 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.841671 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.841833 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.841987 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.842148 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.842316 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.842480 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.842641 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.842819 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.842986 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.843167 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.843397 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.843559 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.843720 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.843961 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.844128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.844302 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.844456 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.844456 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.844764 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.844956 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.845110 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.845313 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.845482 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.845644 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.845798 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.845957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.846112 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.846112 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.846112 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.846714 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.846868 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.847031 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.847194 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.847355 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.847516 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.847670 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.847832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.847832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.848148 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.848311 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.848471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.848625 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.848778 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.848969 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.849149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.849490 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.849661 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.849842 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.849842 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.850238 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.850401 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.850555 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.850716 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.850871 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.851125 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.851378 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.851544 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.851710 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.851864 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.852024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.852178 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.852344 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.852505 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.852665 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.852896 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.853059 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.853212 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.853396 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.853621 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.853792 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.853966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.854191 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.854356 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.854519 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.854681 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.854835 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.854995 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.855148 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.855355 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.855514 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.855667 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.855830 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.856002 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.856159 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.857123 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.857876 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.858304 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.858485 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.858695 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.858859 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.859016 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.859171 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.859337 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.859673 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.859831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.859992 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.860258 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.860420 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.860585 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.860756 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.860944 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.861117 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.871445 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.873560 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.873714 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.873854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.874001 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.874147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.874300 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.874435 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.874576 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.874712 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.874817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.874915 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.875020 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.875159 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.875261 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.875359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.875456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.875545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.875642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.875739 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.875836 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.875925 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.876013 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.876109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.876224 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.876323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.876419 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.876510 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.876605 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.876708 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.876837 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.876918 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.877019 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.877109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.877197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.877345 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.877490 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.877625 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.877759 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.877900 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.877994 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.878098 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.878188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.878284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.878373 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.878461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.878548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.878646 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.878744 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.878835 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.878931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.879020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.879117 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.879215 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.879215 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.879376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.879472 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.879568 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.879740 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.879840 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.879930 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.880026 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.880126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.880267 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.880370 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.880515 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.880658 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.881479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.881574 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.881683 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.881782 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.881872 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.881969 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.882059 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.882059 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.882483 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.882577 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.882665 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.882753 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.882840 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.882935 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.883033 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.883122 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.883209 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.883296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.883391 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.883480 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.883572 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.883669 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.883758 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.883854 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.883951 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.884049 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.884146 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.884242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.884337 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.884426 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.884522 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.884631 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.884735 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.884897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.885032 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.885125 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.885214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.885370 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.885465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.885559 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.885648 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.885744 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.885842 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.885933 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.886020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.886108 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.886202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.886291 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.886392 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.886490 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.886580 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.886668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.886668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.886828 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.886930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.887026 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.887116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.887212 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.887302 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.887389 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.887583 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.887754 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.887906 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.888051 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.888153 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.888257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.888355 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.888445 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.888532 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.888619 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.888722 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.888946 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.889088 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.889230 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.889378 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.889521 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.889659 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.889856 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.890001 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.890096 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.890194 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.890283 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.890382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.890479 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.890582 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.890723 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.890858 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.890991 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.891093 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.891192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.891283 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.891372 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.891487 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.891578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.891682 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.891787 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.891878 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.891974 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.892064 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.892162 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.892261 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.892350 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.892439 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.892534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.892623 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.892725 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.892846 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.892947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.893045 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.893135 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.893231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.893330 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.893428 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.893518 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.893607 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.893704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.893793 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.893890 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.893981 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.894069 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.894156 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.894255 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.894360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.894451 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.894546 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.894642 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.894740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.894829 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.894927 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.895017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.895105 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.895201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.895299 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.895389 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.895488 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.895586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.895676 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.895764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.895853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.895961 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.896103 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.896204 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.896332 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.897133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.897238 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.897328 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.897419 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.897516 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.897606 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.897693 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.897693 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.897965 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.898083 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.898207 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.898332 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.898451 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.898576 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.898714 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.898839 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.898967 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.899084 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.899199 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.899323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.899454 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.899454 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 11:34:29.899681 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.899681 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.899681 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.899681 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.899681 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.899681 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.899681 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.899681 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.900550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.900550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.900550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.900550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.900550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.900550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.900550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.900550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.901561 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.901561 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.901561 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.901561 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.901561 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.901561 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.901561 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.901561 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.902447 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.902447 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.902447 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.902447 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.902447 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.902447 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.902447 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.902447 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903211 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903211 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903211 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903211 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903211 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903211 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903211 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903211 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 11:34:29.903854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 11:34:30.022782 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO dbcounter [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] Registered counter for database nova_api Jul 20 11:34:30.036616 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO dbcounter [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] Registered counter for database nova_api Jul 20 11:34:30.044023 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_db.sqlalchemy.engines [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:34:30.050606 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writer thread running {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:34:30.056744 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_db.sqlalchemy.engines [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:34:30.063191 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writer thread running {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:34:30.106535 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.context [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e43e925f-fe8b-4c11-b417-df3450f348d9(cell1) {{(pid=124830) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 11:34:30.110608 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:30.112237 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:30.113065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:30.115028 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:30.117595 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO dbcounter [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] Registered counter for database nova_cell0 Jul 20 11:34:30.118803 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.context [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e43e925f-fe8b-4c11-b417-df3450f348d9(cell1) {{(pid=124831) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 11:34:30.121567 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO dbcounter [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] Registered counter for database nova_cell1 Jul 20 11:34:30.122888 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:30.124486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:30.125334 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:30.127323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:30.128986 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_db.sqlalchemy.engines [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:34:30.129425 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO dbcounter [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] Registered counter for database nova_cell0 Jul 20 11:34:30.130775 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_db.sqlalchemy.engines [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:34:30.134411 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO dbcounter [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] Registered counter for database nova_cell1 Jul 20 11:34:30.137124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writer thread running {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:34:30.142369 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writer thread running {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:34:30.143616 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_db.sqlalchemy.engines [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:34:30.145317 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_db.sqlalchemy.engines [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:34:30.151295 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writer thread running {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:34:30.153367 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writer thread running {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:34:30.283357 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO dbcounter [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] Registered counter for database nova_cell0 Jul 20 11:34:30.291264 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_db.sqlalchemy.engines [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:34:30.295574 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writer thread running {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:34:30.296403 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO dbcounter [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] Registered counter for database nova_cell0 Jul 20 11:34:30.305388 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_db.sqlalchemy.engines [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 11:34:30.309619 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writer thread running {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 11:34:30.609669 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: WARNING keystonemiddleware.auth_token [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 11:34:30.617500 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: WARNING keystonemiddleware.auth_token [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 11:34:30.629166 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: WARNING keystonemiddleware.auth_token [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 11:34:30.636762 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: WARNING keystonemiddleware.auth_token [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 11:34:30.957888 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: WARNING keystonemiddleware.auth_token [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 11:34:30.964363 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: WARNING keystonemiddleware.auth_token [None req-4edad2a0-689f-4cd1-bfe8-e9dfe0b08a37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 11:34:30.971900 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55717b7709c0 pid: 124830 (default app) Jul 20 11:34:30.981565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: WARNING keystonemiddleware.auth_token [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 11:34:30.987525 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: WARNING keystonemiddleware.auth_token [None req-2e1a78b4-f033-48e8-8bb5-e94eb9d55bbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 11:34:30.993796 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55717b7709c0 pid: 124831 (default app) Jul 20 11:35:13.211785 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:13.213079 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:13.213843 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:13.214996 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:14.198964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-32573068-c3b8-4656-ae6f-d238b955698d tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] Action: 'create', calling method: .version_select at 0x7f44e0ffdc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2005800136", "metadata": {"Type": "work"}}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:16.015411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-32573068-c3b8-4656-ae6f-d238b955698d tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.812377 Jul 20 11:35:16.017133 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jul 20 11:35:13 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2816 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 11:35:16.281224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:16.281224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:16.281224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:16.281224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:16.473662 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-337bb7a9-3058-4a38-881f-5046a4049b5d tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] Calling method '.version_select at 0x7f44e104c790>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:18.545005 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-337bb7a9-3058-4a38-881f-5046a4049b5d tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f768fba4-ae71-4f37-b848-f7b2bd4f3307" status: 200 len: 354 microversion: 2.1 time: 2.514810 Jul 20 11:35:18.546458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 1/2] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:35:16 2022] GET /compute/v2.1/os-volumes/f768fba4-ae71-4f37-b848-f7b2bd4f3307 => generated 354 bytes in 2518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:35:18.559859 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2c6141d8-0548-4634-ab81-94b26108c383 tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] Calling method '.version_select at 0x7f44e0ec7a60>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:18.743491 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2c6141d8-0548-4634-ab81-94b26108c383 tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f768fba4-ae71-4f37-b848-f7b2bd4f3307" status: 200 len: 354 microversion: 2.1 time: 0.189255 Jul 20 11:35:18.744364 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:35:18 2022] GET /compute/v2.1/os-volumes/f768fba4-ae71-4f37-b848-f7b2bd4f3307 => generated 354 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:35:18.769715 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f2f2da0d-14bd-4541-a974-47038f1eafac tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] Calling method '.version_select at 0x7f44e0f11a60>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:19.143805 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f2f2da0d-14bd-4541-a974-47038f1eafac tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/f768fba4-ae71-4f37-b848-f7b2bd4f3307" status: 202 len: 0 microversion: 2.1 time: 0.382840 Jul 20 11:35:19.145063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 11:35:18 2022] DELETE /compute/v2.1/os-volumes/f768fba4-ae71-4f37-b848-f7b2bd4f3307 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:35:19.153741 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0e653566-a1b6-4e83-90e9-7911cbfbf727 tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] Calling method '.version_select at 0x7f44e0ec7b80>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:19.243360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0e653566-a1b6-4e83-90e9-7911cbfbf727 tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f768fba4-ae71-4f37-b848-f7b2bd4f3307" status: 200 len: 353 microversion: 2.1 time: 0.093737 Jul 20 11:35:19.244278 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 3/5] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:35:19 2022] GET /compute/v2.1/os-volumes/f768fba4-ae71-4f37-b848-f7b2bd4f3307 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:35:20.263056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-71902799-e522-4c3e-bd27-c5c7643c22d9 tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] Calling method '.version_select at 0x7f44e0eca160>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:20.321421 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-71902799-e522-4c3e-bd27-c5c7643c22d9 tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] HTTP exception thrown: Volume f768fba4-ae71-4f37-b848-f7b2bd4f3307 could not be found. Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-71902799-e522-4c3e-bd27-c5c7643c22d9 tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] Request method failure captured: Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/os-volumes/f768fba4-ae71-4f37-b848-f7b2bd4f3307 HTTP/1.1 Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-hxdfG2GBRuZRHfSwNQcc33HG3O0HyCinBfw7I2xtNOs6_OLxLtDlq7dUcqxRXZKBa3JAVDtPQ1CIyIs3CHTpwazc1Y-KW8T4O9iWY1ZOUNxWs2e8Vjzi4ASzEi9kA28wR1MSgLCA6SDp46pUnqyYK9HwduCxpPPBNV6mJGsdMwLOk Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: 13f9948806f74355b3f18d48f7b5f517 Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesGetTestJSON-764633636 Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:35:20.325629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:35:20.327145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/13f9948806f74355b3f18d48f7b5f517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/13f9948806f74355b3f18d48f7b5f517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_13f9948806f74355b3f18d48f7b5f517", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/13f9948806f74355b3f18d48f7b5f517"}]}] Jul 20 11:35:20.327145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesGetTestJSON-764633636 Jul 20 11:35:20.327145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 13f9948806f74355b3f18d48f7b5f517 Jul 20 11:35:20.327145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesGetTestJSON-764633636 Jul 20 11:35:20.327145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesGetTestJSON-764633636-project Jul 20 11:35:20.327145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:35:20.327145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:35:20.327145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 4d19e53b473d4bd8b16e21d221416b6d Jul 20 11:35:20.327145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesGetTestJSON-764633636-project Jul 20 11:35:20.327145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: Jul 20 11:35:20.327145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Volume f768fba4-ae71-4f37-b848-f7b2bd4f3307 could not be found. Jul 20 11:35:20.327145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'f768fba4-ae71-4f37-b848-f7b2bd4f3307'} Jul 20 11:35:20.327145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f768fba4-ae71-4f37-b848-f7b2bd4f3307 could not be found. (HTTP 404) (Request-ID: req-dd1f7725-4fec-4a9c-9a15-e326ab820d20) Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:35:20.328118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:35:20.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f768fba4-ae71-4f37-b848-f7b2bd4f3307 could not be found. Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 11:35:20.330569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:35:20.331700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f768fba4-ae71-4f37-b848-f7b2bd4f3307 could not be found. Jul 20 11:35:20.331700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:35:20.331700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:35:20.331700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:35:20.331700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:35:20.331700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:35:20.331700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:35:20.331700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:35:20.331700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:35:20.331700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f768fba4-ae71-4f37-b848-f7b2bd4f3307 could not be found. Jul 20 11:35:20.331700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:35:20.334515 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-71902799-e522-4c3e-bd27-c5c7643c22d9 tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] Returning 404 to user: Volume f768fba4-ae71-4f37-b848-f7b2bd4f3307 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:35:20.334515 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-71902799-e522-4c3e-bd27-c5c7643c22d9 tempest-VolumesGetTestJSON-764633636 tempest-VolumesGetTestJSON-764633636-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f768fba4-ae71-4f37-b848-f7b2bd4f3307" status: 404 len: 109 microversion: 2.1 time: 0.081850 Jul 20 11:35:20.334515 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 3/6] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:35:20 2022] GET /compute/v2.1/os-volumes/f768fba4-ae71-4f37-b848-f7b2bd4f3307 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:35:27.218510 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1866617091", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "networks": [{"uuid": "f227fa67-dce3-4098-ae20-4b5e1994e6ba"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:27.444366 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] validate_networks() for [('f227fa67-dce3-4098-ae20-4b5e1994e6ba', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:35:31.610830 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1446423845", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:31.610830 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] validate_networks() for [('992b70eb-8a72-41d6-bb82-4697065dd2d5', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:35:31.623235 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:35:31.623235 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:35:31.623235 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:35:31.623235 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:35:31.623235 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:35:31.627883 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:31.627883 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:31.627883 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:31.627883 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:31.629673 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Getting quotas for project 768253801a774aa49d29c8176c46cafb. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:35:31.629673 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Getting quotas for user 71e1209f5e4c4813933d7870e0a21e7d and project 768253801a774aa49d29c8176c46cafb. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:35:31.629673 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:35:31.630354 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:35:31.630354 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:35:31.630354 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:35:31.630354 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:35:31.630354 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:35:31.632190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:35:31.633153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:31.633153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:31.633153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:31.633153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:31.634106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Getting quotas for project 9192fe06f92b47cfbc286bb76e97410b. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:35:31.634106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Getting quotas for user 51876164aea741cc873ba4755e6c6fcd and project 9192fe06f92b47cfbc286bb76e97410b. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:35:31.634106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:35:31.634729 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:35:31.728766 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-276a4988-7238-4b80-9525-240e5c3e0ed2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.479324 Jul 20 11:35:31.729778 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 4/7] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:35:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:35:31.764483 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8c00ce51-eb14-403c-979f-515afd9145f2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.027810 Jul 20 11:35:31.765623 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 4/8] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:35:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 5030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:35:31.775936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-97d5e943-019b-4421-aea9-276da4cb0acd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:31.782774 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-97d5e943-019b-4421-aea9-276da4cb0acd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:32.080377 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-97d5e943-019b-4421-aea9-276da4cb0acd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:32.101177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-97d5e943-019b-4421-aea9-276da4cb0acd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1222 microversion: 2.1 time: 0.333886 Jul 20 11:35:32.106463 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 5/9] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:31 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1222 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:32.123703 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-95ecb8a5-eb65-4754-ad76-addf7fdf9f96 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:32.126110 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-95ecb8a5-eb65-4754-ad76-addf7fdf9f96 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:32.278367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95ecb8a5-eb65-4754-ad76-addf7fdf9f96 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:32.297940 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-95ecb8a5-eb65-4754-ad76-addf7fdf9f96 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1215 microversion: 2.1 time: 0.187628 Jul 20 11:35:32.297940 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 6/10] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:32 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:32.622337 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-77d88788-a86f-484a-b949-d02b140cd131 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Action: 'create', calling method: .version_select at 0x7f44e053a670>, body: {"keypair": {"name": "tempest-keypair-1681288528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUlzMACjGtPCVFSMFQClZR+HTz/YGasF+mDYgP7seOxf/OOup73Rny77b9nlzjbt8ET6luVuDx45M60inqK9D8R7ga+dOx92tRY/TOHUkPBrXXP7Aui9m8YJ8sG4WuELg=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:32.660456 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-77d88788-a86f-484a-b949-d02b140cd131 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for project d4fa73c956fe44a59272f727320743e0. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:35:32.676441 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-77d88788-a86f-484a-b949-d02b140cd131 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for user 54c7d577e64f48cab8c331ff192be0a6 and project d4fa73c956fe44a59272f727320743e0. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:35:32.728964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1996936488", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:32.838538 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] validate_networks() for [('992b70eb-8a72-41d6-bb82-4697065dd2d5', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:35:32.846164 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-77d88788-a86f-484a-b949-d02b140cd131 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.115168 Jul 20 11:35:32.851935 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 5/11] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 11:35:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:35:33.315428 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0148d00d-67ec-4635-91c7-08af886e1d4c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:33.316698 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0148d00d-67ec-4635-91c7-08af886e1d4c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:33.576229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0148d00d-67ec-4635-91c7-08af886e1d4c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:33.627556 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0148d00d-67ec-4635-91c7-08af886e1d4c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1215 microversion: 2.1 time: 0.316368 Jul 20 11:35:33.629864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:33 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1215 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:35:34.411357 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:35:34.411357 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:35:34.411357 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:35:34.411357 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:35:34.411357 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:35:34.430671 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:34.437762 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:34.437762 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:34.437762 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:34.481821 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Getting quotas for project 9192fe06f92b47cfbc286bb76e97410b. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:35:34.487442 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Getting quotas for user 51876164aea741cc873ba4755e6c6fcd and project 9192fe06f92b47cfbc286bb76e97410b. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:35:34.503299 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:35:34.509023 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:35:34.647861 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4333b882-dccf-4be1-99c6-5ffeaaae3897 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:34.649899 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4333b882-dccf-4be1-99c6-5ffeaaae3897 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:34.710601 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f32dac6e-be6a-4c2d-a778-6f0427e19bc1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.993673 Jul 20 11:35:34.715865 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 7/13] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:35:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:35:34.741576 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-72032afb-4868-45b8-9265-c53aa1f243f8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:34.741576 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-72032afb-4868-45b8-9265-c53aa1f243f8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:34.892964 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4333b882-dccf-4be1-99c6-5ffeaaae3897 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:34.903214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4333b882-dccf-4be1-99c6-5ffeaaae3897 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1215 microversion: 2.1 time: 0.260031 Jul 20 11:35:34.907653 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 7/14] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:34 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:35.026185 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-72032afb-4868-45b8-9265-c53aa1f243f8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:35.035292 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-72032afb-4868-45b8-9265-c53aa1f243f8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1222 microversion: 2.1 time: 0.317317 Jul 20 11:35:35.042160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 8/15] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:34 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1222 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:35.920369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-253d2c72-9cbe-4c76-acaa-f3a6c6575ba6 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:35.921792 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-253d2c72-9cbe-4c76-acaa-f3a6c6575ba6 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:35.933820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-253d2c72-9cbe-4c76-acaa-f3a6c6575ba6 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:35.934296 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-253d2c72-9cbe-4c76-acaa-f3a6c6575ba6 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:35.935083 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-253d2c72-9cbe-4c76-acaa-f3a6c6575ba6 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:35.935522 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-253d2c72-9cbe-4c76-acaa-f3a6c6575ba6 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:36.060433 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-63630de1-ee7f-43e1-8deb-49fe398b73a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:36.062074 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-63630de1-ee7f-43e1-8deb-49fe398b73a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:36.077412 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63630de1-ee7f-43e1-8deb-49fe398b73a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:36.077872 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63630de1-ee7f-43e1-8deb-49fe398b73a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:36.079055 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63630de1-ee7f-43e1-8deb-49fe398b73a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:36.079635 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-63630de1-ee7f-43e1-8deb-49fe398b73a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:36.176300 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-253d2c72-9cbe-4c76-acaa-f3a6c6575ba6 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:36.197214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-253d2c72-9cbe-4c76-acaa-f3a6c6575ba6 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1211 microversion: 2.1 time: 0.281023 Jul 20 11:35:36.209215 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:35 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1211 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:36.393380 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-63630de1-ee7f-43e1-8deb-49fe398b73a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:36.413660 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-63630de1-ee7f-43e1-8deb-49fe398b73a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1226 microversion: 2.1 time: 0.359084 Jul 20 11:35:36.416422 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 9/17] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:36 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1226 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:37.216378 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-88eb0ac1-8863-4064-82bc-122d4fccb9e1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:37.222905 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-88eb0ac1-8863-4064-82bc-122d4fccb9e1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:37.223336 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88eb0ac1-8863-4064-82bc-122d4fccb9e1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:37.223548 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88eb0ac1-8863-4064-82bc-122d4fccb9e1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:37.224558 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88eb0ac1-8863-4064-82bc-122d4fccb9e1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:37.225215 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-88eb0ac1-8863-4064-82bc-122d4fccb9e1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:37.423318 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-88eb0ac1-8863-4064-82bc-122d4fccb9e1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:37.435642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ef51f4a1-da79-49a8-81a3-f3b19a8833dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:37.439795 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ef51f4a1-da79-49a8-81a3-f3b19a8833dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:37.451087 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-88eb0ac1-8863-4064-82bc-122d4fccb9e1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1267 microversion: 2.1 time: 0.238435 Jul 20 11:35:37.451683 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 9/18] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:37 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:37.452377 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef51f4a1-da79-49a8-81a3-f3b19a8833dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:37.454801 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef51f4a1-da79-49a8-81a3-f3b19a8833dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:37.454801 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef51f4a1-da79-49a8-81a3-f3b19a8833dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:37.454801 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef51f4a1-da79-49a8-81a3-f3b19a8833dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:37.543210 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ef51f4a1-da79-49a8-81a3-f3b19a8833dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:37.551332 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ef51f4a1-da79-49a8-81a3-f3b19a8833dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1274 microversion: 2.1 time: 0.122064 Jul 20 11:35:37.554248 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 10/19] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:37 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:38.137595 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-40243563", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85e4b01a-11ce-4686-bb2f-1c5b19de2e34"}], "security_groups": [{"name": "tempest-securitygroup--752115517"}], "key_name": "tempest-keypair-1681288528", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:38.310347 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] validate_networks() for [('85e4b01a-11ce-4686-bb2f-1c5b19de2e34', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:35:38.468532 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8acad861-cbda-4af7-b8aa-d3daad304f8c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:38.469227 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8acad861-cbda-4af7-b8aa-d3daad304f8c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:38.476989 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8acad861-cbda-4af7-b8aa-d3daad304f8c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:38.477691 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8acad861-cbda-4af7-b8aa-d3daad304f8c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:38.478578 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8acad861-cbda-4af7-b8aa-d3daad304f8c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:38.479080 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8acad861-cbda-4af7-b8aa-d3daad304f8c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:38.562267 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8acad861-cbda-4af7-b8aa-d3daad304f8c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:38.571254 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8acad861-cbda-4af7-b8aa-d3daad304f8c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1267 microversion: 2.1 time: 0.106580 Jul 20 11:35:38.572874 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 11/20] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:38 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:35:38.579865 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8e3b21ec-9dfa-4d08-be91-77ba780a131e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:38.588254 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8e3b21ec-9dfa-4d08-be91-77ba780a131e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:38.598510 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e3b21ec-9dfa-4d08-be91-77ba780a131e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:38.598971 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e3b21ec-9dfa-4d08-be91-77ba780a131e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:38.600288 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e3b21ec-9dfa-4d08-be91-77ba780a131e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:38.605302 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8e3b21ec-9dfa-4d08-be91-77ba780a131e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:38.715914 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8e3b21ec-9dfa-4d08-be91-77ba780a131e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:38.744910 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8e3b21ec-9dfa-4d08-be91-77ba780a131e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1274 microversion: 2.1 time: 0.169664 Jul 20 11:35:38.750787 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 12/21] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:38 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1274 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:38.884557 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:35:38.885000 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:35:38.885473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:35:38.886513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:35:38.887383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:35:38.899641 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:38.900402 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:38.901446 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:38.902044 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:38.939176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for project d4fa73c956fe44a59272f727320743e0. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:35:38.943425 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for user 54c7d577e64f48cab8c331ff192be0a6 and project d4fa73c956fe44a59272f727320743e0. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:35:38.954602 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:35:38.956951 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:35:39.070961 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-09962730-5c47-4c82-992a-ca4300396cf5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.937552 Jul 20 11:35:39.076563 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 10/22] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:35:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:35:39.096351 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f2b03d8e-79d7-4fe1-9197-d32a8c4feaa6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:39.096351 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f2b03d8e-79d7-4fe1-9197-d32a8c4feaa6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:39.170125 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2b03d8e-79d7-4fe1-9197-d32a8c4feaa6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:39.177212 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f2b03d8e-79d7-4fe1-9197-d32a8c4feaa6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1240 microversion: 2.1 time: 0.098529 Jul 20 11:35:39.177897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 13/23] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:39 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:39.596360 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9425588-3742-45a4-b455-898b5aedf44e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:39.597421 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9425588-3742-45a4-b455-898b5aedf44e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:39.610782 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9425588-3742-45a4-b455-898b5aedf44e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:39.611318 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9425588-3742-45a4-b455-898b5aedf44e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:39.612104 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9425588-3742-45a4-b455-898b5aedf44e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:39.614428 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9425588-3742-45a4-b455-898b5aedf44e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:39.680241 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e9425588-3742-45a4-b455-898b5aedf44e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:39.687631 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9425588-3742-45a4-b455-898b5aedf44e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1267 microversion: 2.1 time: 0.095147 Jul 20 11:35:39.688193 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 11/24] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:39 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:39.763219 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-67d357b4-7bf2-48b1-818b-1ac1f43ec599 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:39.764472 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-67d357b4-7bf2-48b1-818b-1ac1f43ec599 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:39.771500 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67d357b4-7bf2-48b1-818b-1ac1f43ec599 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:39.772160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67d357b4-7bf2-48b1-818b-1ac1f43ec599 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:39.773148 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67d357b4-7bf2-48b1-818b-1ac1f43ec599 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:39.773586 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-67d357b4-7bf2-48b1-818b-1ac1f43ec599 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:39.853137 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-67d357b4-7bf2-48b1-818b-1ac1f43ec599 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:39.860987 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-67d357b4-7bf2-48b1-818b-1ac1f43ec599 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1274 microversion: 2.1 time: 0.102009 Jul 20 11:35:39.863397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 14/25] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:39 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:40.196116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a9041055-0c55-4c9b-ba80-324dfb9035e8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:40.197063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a9041055-0c55-4c9b-ba80-324dfb9035e8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:40.252939 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a9041055-0c55-4c9b-ba80-324dfb9035e8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:40.260506 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a9041055-0c55-4c9b-ba80-324dfb9035e8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1240 microversion: 2.1 time: 0.070490 Jul 20 11:35:40.261463 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 12/26] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:40 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:40.715858 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8ab2ef3b-6c98-46e2-8b06-e2babffc0040 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:40.715858 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8ab2ef3b-6c98-46e2-8b06-e2babffc0040 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:40.731406 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ab2ef3b-6c98-46e2-8b06-e2babffc0040 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:40.732506 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ab2ef3b-6c98-46e2-8b06-e2babffc0040 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:40.734373 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ab2ef3b-6c98-46e2-8b06-e2babffc0040 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:40.736109 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ab2ef3b-6c98-46e2-8b06-e2babffc0040 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:40.820526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8ab2ef3b-6c98-46e2-8b06-e2babffc0040 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:40.828521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8ab2ef3b-6c98-46e2-8b06-e2babffc0040 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1267 microversion: 2.1 time: 0.127647 Jul 20 11:35:40.829603 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 15/27] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:40 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1267 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:40.879708 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e7271995-63ee-4133-8552-fedb803f7d8d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:40.880493 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e7271995-63ee-4133-8552-fedb803f7d8d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:40.890301 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7271995-63ee-4133-8552-fedb803f7d8d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:40.890784 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7271995-63ee-4133-8552-fedb803f7d8d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:40.891609 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7271995-63ee-4133-8552-fedb803f7d8d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:40.892653 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7271995-63ee-4133-8552-fedb803f7d8d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:40.960006 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e7271995-63ee-4133-8552-fedb803f7d8d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:40.967588 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e7271995-63ee-4133-8552-fedb803f7d8d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1274 microversion: 2.1 time: 0.091834 Jul 20 11:35:40.968167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 13/28] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:40 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:41.283707 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e1bec06b-f163-4c5e-af15-20eca4751bfe tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:41.284490 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e1bec06b-f163-4c5e-af15-20eca4751bfe tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:41.291521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1bec06b-f163-4c5e-af15-20eca4751bfe tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:41.292027 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1bec06b-f163-4c5e-af15-20eca4751bfe tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:41.292831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1bec06b-f163-4c5e-af15-20eca4751bfe tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:41.293276 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e1bec06b-f163-4c5e-af15-20eca4751bfe tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:41.353609 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e1bec06b-f163-4c5e-af15-20eca4751bfe tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:41.360857 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e1bec06b-f163-4c5e-af15-20eca4751bfe tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1244 microversion: 2.1 time: 0.080902 Jul 20 11:35:41.361415 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 16/29] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:41 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:41.847666 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-54162cb7-a6c4-43d3-8ea5-94bc87d2779e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:41.849063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-54162cb7-a6c4-43d3-8ea5-94bc87d2779e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:41.856451 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54162cb7-a6c4-43d3-8ea5-94bc87d2779e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:41.856954 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54162cb7-a6c4-43d3-8ea5-94bc87d2779e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:41.857765 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54162cb7-a6c4-43d3-8ea5-94bc87d2779e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:41.858206 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54162cb7-a6c4-43d3-8ea5-94bc87d2779e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:41.926807 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-54162cb7-a6c4-43d3-8ea5-94bc87d2779e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:41.934036 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-54162cb7-a6c4-43d3-8ea5-94bc87d2779e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1267 microversion: 2.1 time: 0.092082 Jul 20 11:35:41.934908 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 14/30] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:41 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:41.986448 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a6caa11f-5664-46a2-adc2-452fe5489236 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:41.987767 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a6caa11f-5664-46a2-adc2-452fe5489236 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:41.996997 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6caa11f-5664-46a2-adc2-452fe5489236 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:41.997461 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6caa11f-5664-46a2-adc2-452fe5489236 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:41.998239 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6caa11f-5664-46a2-adc2-452fe5489236 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:41.998793 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6caa11f-5664-46a2-adc2-452fe5489236 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:42.097398 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a6caa11f-5664-46a2-adc2-452fe5489236 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:42.108731 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a6caa11f-5664-46a2-adc2-452fe5489236 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1274 microversion: 2.1 time: 0.127649 Jul 20 11:35:42.114269 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 17/31] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:41 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:42.377686 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cb44e3a7-c802-4a66-89ff-caee662921f0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:42.378292 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cb44e3a7-c802-4a66-89ff-caee662921f0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:42.385244 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb44e3a7-c802-4a66-89ff-caee662921f0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:42.385778 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb44e3a7-c802-4a66-89ff-caee662921f0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:42.386657 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb44e3a7-c802-4a66-89ff-caee662921f0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:42.387157 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb44e3a7-c802-4a66-89ff-caee662921f0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:42.450224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cb44e3a7-c802-4a66-89ff-caee662921f0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:42.457655 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cb44e3a7-c802-4a66-89ff-caee662921f0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1244 microversion: 2.1 time: 0.083849 Jul 20 11:35:42.458212 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 15/32] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:42 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:42.952089 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9dd9fa74-fae8-4a01-b116-3c2a103159dd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:42.953029 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9dd9fa74-fae8-4a01-b116-3c2a103159dd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:42.963465 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9dd9fa74-fae8-4a01-b116-3c2a103159dd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:42.966218 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9dd9fa74-fae8-4a01-b116-3c2a103159dd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:42.967115 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9dd9fa74-fae8-4a01-b116-3c2a103159dd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:42.970336 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9dd9fa74-fae8-4a01-b116-3c2a103159dd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:43.126373 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-18bb02a5-27fa-43cd-8d04-d7ab40202c2e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:43.127730 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-18bb02a5-27fa-43cd-8d04-d7ab40202c2e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:43.138275 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18bb02a5-27fa-43cd-8d04-d7ab40202c2e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:43.140096 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18bb02a5-27fa-43cd-8d04-d7ab40202c2e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:43.141661 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18bb02a5-27fa-43cd-8d04-d7ab40202c2e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:43.143119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-18bb02a5-27fa-43cd-8d04-d7ab40202c2e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:43.152160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9dd9fa74-fae8-4a01-b116-3c2a103159dd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:43.164724 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9dd9fa74-fae8-4a01-b116-3c2a103159dd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1275 microversion: 2.1 time: 0.215729 Jul 20 11:35:43.165427 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 18/33] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:42 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:43.273067 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-18bb02a5-27fa-43cd-8d04-d7ab40202c2e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:43.293213 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-18bb02a5-27fa-43cd-8d04-d7ab40202c2e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1282 microversion: 2.1 time: 0.169745 Jul 20 11:35:43.294064 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 16/34] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:43 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:43.477238 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8a635aa7-80f6-4666-96da-5fbfa7e749dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:43.478392 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8a635aa7-80f6-4666-96da-5fbfa7e749dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:43.487293 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a635aa7-80f6-4666-96da-5fbfa7e749dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:43.488112 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a635aa7-80f6-4666-96da-5fbfa7e749dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:43.489320 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a635aa7-80f6-4666-96da-5fbfa7e749dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:43.490620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a635aa7-80f6-4666-96da-5fbfa7e749dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:43.695060 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8a635aa7-80f6-4666-96da-5fbfa7e749dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:43.713564 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8a635aa7-80f6-4666-96da-5fbfa7e749dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1292 microversion: 2.1 time: 0.241742 Jul 20 11:35:43.729788 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 19/35] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:43 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1292 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:44.189048 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8e3140b5-ce33-4c58-ac9a-db763a53743c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:44.189657 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8e3140b5-ce33-4c58-ac9a-db763a53743c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:44.206741 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e3140b5-ce33-4c58-ac9a-db763a53743c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:44.207225 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e3140b5-ce33-4c58-ac9a-db763a53743c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:44.208072 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e3140b5-ce33-4c58-ac9a-db763a53743c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:44.209123 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e3140b5-ce33-4c58-ac9a-db763a53743c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:44.311182 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0f77c937-f133-462e-862c-98e2e7268756 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:44.312544 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0f77c937-f133-462e-862c-98e2e7268756 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:44.327644 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f77c937-f133-462e-862c-98e2e7268756 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:44.328404 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f77c937-f133-462e-862c-98e2e7268756 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:44.332357 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f77c937-f133-462e-862c-98e2e7268756 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:44.334197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f77c937-f133-462e-862c-98e2e7268756 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:44.448105 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:44.556360 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8e3140b5-ce33-4c58-ac9a-db763a53743c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:44.562904 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0f77c937-f133-462e-862c-98e2e7268756 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:44.566963 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8e3140b5-ce33-4c58-ac9a-db763a53743c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1273 microversion: 2.1 time: 0.381667 Jul 20 11:35:44.572538 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 17/36] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:44 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1273 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:44.573533 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0f77c937-f133-462e-862c-98e2e7268756 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1280 microversion: 2.1 time: 0.266222 Jul 20 11:35:44.574325 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 20/37] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:44 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1280 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:35:44.734870 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-edc7b09d-8e5e-4f29-b5f1-2fce0e9bf015 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:44.736285 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-edc7b09d-8e5e-4f29-b5f1-2fce0e9bf015 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:44.748646 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edc7b09d-8e5e-4f29-b5f1-2fce0e9bf015 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:44.749773 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edc7b09d-8e5e-4f29-b5f1-2fce0e9bf015 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:44.751399 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edc7b09d-8e5e-4f29-b5f1-2fce0e9bf015 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:44.752083 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-edc7b09d-8e5e-4f29-b5f1-2fce0e9bf015 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:44.879384 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-edc7b09d-8e5e-4f29-b5f1-2fce0e9bf015 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:44.891535 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-edc7b09d-8e5e-4f29-b5f1-2fce0e9bf015 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1298 microversion: 2.1 time: 0.160955 Jul 20 11:35:44.892224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 18/38] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:44 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1298 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:45.593360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2eb245ad-a545-4e09-a124-70597fab9b7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:45.593944 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-30e4f4b9-2a88-4b62-86d2-1ef1216c209d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:45.594305 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-30e4f4b9-2a88-4b62-86d2-1ef1216c209d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:45.594434 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2eb245ad-a545-4e09-a124-70597fab9b7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:45.607519 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30e4f4b9-2a88-4b62-86d2-1ef1216c209d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:45.607519 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30e4f4b9-2a88-4b62-86d2-1ef1216c209d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:45.607519 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30e4f4b9-2a88-4b62-86d2-1ef1216c209d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:45.607732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2eb245ad-a545-4e09-a124-70597fab9b7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:45.607732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2eb245ad-a545-4e09-a124-70597fab9b7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:45.612748 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2eb245ad-a545-4e09-a124-70597fab9b7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:45.616471 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2eb245ad-a545-4e09-a124-70597fab9b7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:45.623269 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-30e4f4b9-2a88-4b62-86d2-1ef1216c209d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:45.877895 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-30e4f4b9-2a88-4b62-86d2-1ef1216c209d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:45.893945 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-30e4f4b9-2a88-4b62-86d2-1ef1216c209d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1280 microversion: 2.1 time: 0.304077 Jul 20 11:35:45.896820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 19/39] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:45 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1280 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:35:45.910355 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4f80cd85-94dc-4633-a5d8-ea0c5da7649c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:45.917210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4f80cd85-94dc-4633-a5d8-ea0c5da7649c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:45.942001 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f80cd85-94dc-4633-a5d8-ea0c5da7649c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:45.942458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f80cd85-94dc-4633-a5d8-ea0c5da7649c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:45.943487 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f80cd85-94dc-4633-a5d8-ea0c5da7649c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:45.943933 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f80cd85-94dc-4633-a5d8-ea0c5da7649c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:46.370853 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4f80cd85-94dc-4633-a5d8-ea0c5da7649c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:46.383087 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4f80cd85-94dc-4633-a5d8-ea0c5da7649c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1298 microversion: 2.1 time: 0.475506 Jul 20 11:35:46.392833 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 20/40] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:45 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1298 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:46.669287 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2eb245ad-a545-4e09-a124-70597fab9b7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:46.689830 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2eb245ad-a545-4e09-a124-70597fab9b7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 1.107764 Jul 20 11:35:46.690762 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 21/41] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:45 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:46.911396 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bdd6bf99-043f-4843-a80b-3af5da4c1c9c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:46.912054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bdd6bf99-043f-4843-a80b-3af5da4c1c9c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:46.930813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdd6bf99-043f-4843-a80b-3af5da4c1c9c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:46.931270 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdd6bf99-043f-4843-a80b-3af5da4c1c9c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:46.936758 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdd6bf99-043f-4843-a80b-3af5da4c1c9c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:46.937317 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bdd6bf99-043f-4843-a80b-3af5da4c1c9c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:47.271556 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bdd6bf99-043f-4843-a80b-3af5da4c1c9c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:47.279720 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bdd6bf99-043f-4843-a80b-3af5da4c1c9c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1280 microversion: 2.1 time: 0.371948 Jul 20 11:35:47.299212 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 21/42] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:46 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1280 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:47.407382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-928b74de-bd75-4a51-9021-443eda1f0f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:47.407382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-928b74de-bd75-4a51-9021-443eda1f0f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:47.425893 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-928b74de-bd75-4a51-9021-443eda1f0f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:47.426672 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-928b74de-bd75-4a51-9021-443eda1f0f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:47.428109 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-928b74de-bd75-4a51-9021-443eda1f0f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:47.429646 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-928b74de-bd75-4a51-9021-443eda1f0f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:47.709887 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8812382d-450a-4eff-820d-b577f0dd18d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:47.710611 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8812382d-450a-4eff-820d-b577f0dd18d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:47.725453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8812382d-450a-4eff-820d-b577f0dd18d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:47.727097 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8812382d-450a-4eff-820d-b577f0dd18d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:47.729318 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8812382d-450a-4eff-820d-b577f0dd18d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:47.729929 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8812382d-450a-4eff-820d-b577f0dd18d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:47.798338 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-928b74de-bd75-4a51-9021-443eda1f0f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:47.828643 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-928b74de-bd75-4a51-9021-443eda1f0f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1298 microversion: 2.1 time: 0.418402 Jul 20 11:35:47.828643 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 22/43] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:47 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1298 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:35:48.022407 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8812382d-450a-4eff-820d-b577f0dd18d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:48.049475 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8812382d-450a-4eff-820d-b577f0dd18d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.344950 Jul 20 11:35:48.058116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 22/44] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:47 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:35:48.305326 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-089a31cf-fc0d-47b4-a920-917c05eabd71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:48.306006 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-089a31cf-fc0d-47b4-a920-917c05eabd71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:48.318442 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-089a31cf-fc0d-47b4-a920-917c05eabd71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:48.323794 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-089a31cf-fc0d-47b4-a920-917c05eabd71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:48.325017 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-089a31cf-fc0d-47b4-a920-917c05eabd71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:48.325611 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-089a31cf-fc0d-47b4-a920-917c05eabd71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:48.854006 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-05191987-97c8-4864-936e-37b169611c18 req-b930dcee-adac-4a63-ab53-8997294fd1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a924d70d-5553-4f03-b899-e19681c65665", "tag": "e37711f1-e868-4bcd-9979-13231c875b65"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:48.882383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-05191987-97c8-4864-936e-37b169611c18 req-b930dcee-adac-4a63-ab53-8997294fd1a6 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:48.887233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-05191987-97c8-4864-936e-37b169611c18 req-b930dcee-adac-4a63-ab53-8997294fd1a6 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:48.924126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:48.939838 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-05191987-97c8-4864-936e-37b169611c18 req-b930dcee-adac-4a63-ab53-8997294fd1a6 service nova] Creating event network-changed:e37711f1-e868-4bcd-9979-13231c875b65 for instance a924d70d-5553-4f03-b899-e19681c65665 on hv-cinder-82282 Jul 20 11:35:48.939838 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-05191987-97c8-4864-936e-37b169611c18 req-b930dcee-adac-4a63-ab53-8997294fd1a6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 11:35:48.939838 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c698565b-efe5-4a4b-b434-df762cd05217 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:48.939838 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c698565b-efe5-4a4b-b434-df762cd05217 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:48.939838 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c698565b-efe5-4a4b-b434-df762cd05217 None None] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:48.940291 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c698565b-efe5-4a4b-b434-df762cd05217 None None] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:48.959916 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.compute.rpcapi [None req-c698565b-efe5-4a4b-b434-df762cd05217 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 11:35:48.962957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c698565b-efe5-4a4b-b434-df762cd05217 None None] Releasing lock "compute-rpcapi-router" {{(pid=124831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 11:35:49.014784 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c698565b-efe5-4a4b-b434-df762cd05217 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.516556 Jul 20 11:35:49.014784 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 23/45] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:35:49.026139 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f05e7e84-63eb-4690-a84c-d03b038da0a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:49.026947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f05e7e84-63eb-4690-a84c-d03b038da0a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:49.040821 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f05e7e84-63eb-4690-a84c-d03b038da0a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:49.043310 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f05e7e84-63eb-4690-a84c-d03b038da0a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:49.045261 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f05e7e84-63eb-4690-a84c-d03b038da0a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:49.045771 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f05e7e84-63eb-4690-a84c-d03b038da0a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:49.174131 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=20 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:49.270966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-089a31cf-fc0d-47b4-a920-917c05eabd71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:49.302699 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-089a31cf-fc0d-47b4-a920-917c05eabd71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 1.006297 Jul 20 11:35:49.323984 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 23/46] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:48 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:49.330422 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-691b34c3-bb4d-473a-a590-46296d110aac tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:49.333780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-691b34c3-bb4d-473a-a590-46296d110aac tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:49.341806 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-691b34c3-bb4d-473a-a590-46296d110aac tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:49.350954 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-691b34c3-bb4d-473a-a590-46296d110aac tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:49.351800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-691b34c3-bb4d-473a-a590-46296d110aac tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:49.352254 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-691b34c3-bb4d-473a-a590-46296d110aac tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:49.868964 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f05e7e84-63eb-4690-a84c-d03b038da0a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:49.879046 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f05e7e84-63eb-4690-a84c-d03b038da0a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.865439 Jul 20 11:35:49.885416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 24/47] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:49 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:50.287337 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-691b34c3-bb4d-473a-a590-46296d110aac tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:50.309911 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-691b34c3-bb4d-473a-a590-46296d110aac tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.984769 Jul 20 11:35:50.314736 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 24/48] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:49 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:50.330908 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cbfb1cee-a12f-4c90-bf38-35f99fc3ea98 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:50.338803 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cbfb1cee-a12f-4c90-bf38-35f99fc3ea98 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:50.360612 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=22 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:50.362329 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbfb1cee-a12f-4c90-bf38-35f99fc3ea98 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:50.362778 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbfb1cee-a12f-4c90-bf38-35f99fc3ea98 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:50.377306 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbfb1cee-a12f-4c90-bf38-35f99fc3ea98 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:50.377306 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbfb1cee-a12f-4c90-bf38-35f99fc3ea98 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:50.910358 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-26a9d3a5-d415-4633-aef7-b975662727fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:50.910994 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-26a9d3a5-d415-4633-aef7-b975662727fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:50.920526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26a9d3a5-d415-4633-aef7-b975662727fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:50.921007 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26a9d3a5-d415-4633-aef7-b975662727fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:50.923033 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26a9d3a5-d415-4633-aef7-b975662727fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:50.923033 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-26a9d3a5-d415-4633-aef7-b975662727fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:51.156837 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cbfb1cee-a12f-4c90-bf38-35f99fc3ea98 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:51.173377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cbfb1cee-a12f-4c90-bf38-35f99fc3ea98 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.846526 Jul 20 11:35:51.182915 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 25/49] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:50 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:51.343453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d5fe203-1496-4b97-bf0e-044a70595202 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:51.344833 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d5fe203-1496-4b97-bf0e-044a70595202 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:51.356662 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d5fe203-1496-4b97-bf0e-044a70595202 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:51.357425 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d5fe203-1496-4b97-bf0e-044a70595202 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:51.358380 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d5fe203-1496-4b97-bf0e-044a70595202 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:51.359073 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d5fe203-1496-4b97-bf0e-044a70595202 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:51.371820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:52.021743 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-26a9d3a5-d415-4633-aef7-b975662727fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:52.028991 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:52.034746 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-26a9d3a5-d415-4633-aef7-b975662727fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 1.129609 Jul 20 11:35:52.038084 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 25/50] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:50 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:52.243725 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-3f507722-eeaf-4a05-b08e-5426e6044200 req-f4195544-20d1-472e-900f-6e2a543be934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c74b02-2e59-452e-9d39-949b9325a4e4", "tag": "fa80c6ca-bceb-4f8e-a20a-e0d485f3c1d1"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:52.354893 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3f507722-eeaf-4a05-b08e-5426e6044200 req-f4195544-20d1-472e-900f-6e2a543be934 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:52.355465 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3f507722-eeaf-4a05-b08e-5426e6044200 req-f4195544-20d1-472e-900f-6e2a543be934 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:52.400995 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d5fe203-1496-4b97-bf0e-044a70595202 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:52.410954 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3d5fe203-1496-4b97-bf0e-044a70595202 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 1.079686 Jul 20 11:35:52.412797 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 26/51] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:51 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:52.417874 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-362a2742-47d7-4689-863a-947290f8da4c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:52.418734 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-362a2742-47d7-4689-863a-947290f8da4c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:52.429089 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-362a2742-47d7-4689-863a-947290f8da4c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:52.429815 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-362a2742-47d7-4689-863a-947290f8da4c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:52.430839 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-362a2742-47d7-4689-863a-947290f8da4c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:52.431646 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-362a2742-47d7-4689-863a-947290f8da4c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:52.465612 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-3f507722-eeaf-4a05-b08e-5426e6044200 req-f4195544-20d1-472e-900f-6e2a543be934 service nova] Creating event network-changed:fa80c6ca-bceb-4f8e-a20a-e0d485f3c1d1 for instance 67c74b02-2e59-452e-9d39-949b9325a4e4 on hv-cinder-82282 Jul 20 11:35:52.466152 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3f507722-eeaf-4a05-b08e-5426e6044200 req-f4195544-20d1-472e-900f-6e2a543be934 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124830) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 11:35:52.467876 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb8a6de2-ac40-42ed-8e5a-c1db042c06bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:52.468531 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb8a6de2-ac40-42ed-8e5a-c1db042c06bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:52.469355 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb8a6de2-ac40-42ed-8e5a-c1db042c06bd None None] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:52.470198 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb8a6de2-ac40-42ed-8e5a-c1db042c06bd None None] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:52.487966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.compute.rpcapi [None req-fb8a6de2-ac40-42ed-8e5a-c1db042c06bd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 11:35:52.490462 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fb8a6de2-ac40-42ed-8e5a-c1db042c06bd None None] Releasing lock "compute-rpcapi-router" {{(pid=124830) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 11:35:52.534383 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fb8a6de2-ac40-42ed-8e5a-c1db042c06bd None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.494743 Jul 20 11:35:52.535008 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 26/52] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:35:53.061128 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-654822fb-f7d0-44bb-8230-7569c5fd6440 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:53.062689 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-654822fb-f7d0-44bb-8230-7569c5fd6440 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:53.071262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-654822fb-f7d0-44bb-8230-7569c5fd6440 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:53.072617 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-654822fb-f7d0-44bb-8230-7569c5fd6440 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:53.073587 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-654822fb-f7d0-44bb-8230-7569c5fd6440 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:53.074335 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-654822fb-f7d0-44bb-8230-7569c5fd6440 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:53.101805 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-362a2742-47d7-4689-863a-947290f8da4c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:53.115741 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-362a2742-47d7-4689-863a-947290f8da4c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.699948 Jul 20 11:35:53.116338 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 27/53] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:52 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:53.440849 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-368d077c-3dbd-4db9-b6ce-77e90ff5a29e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:53.440849 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-368d077c-3dbd-4db9-b6ce-77e90ff5a29e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:53.467505 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-368d077c-3dbd-4db9-b6ce-77e90ff5a29e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:53.468189 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-368d077c-3dbd-4db9-b6ce-77e90ff5a29e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:53.469259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-368d077c-3dbd-4db9-b6ce-77e90ff5a29e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:53.470809 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-368d077c-3dbd-4db9-b6ce-77e90ff5a29e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:53.847616 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-654822fb-f7d0-44bb-8230-7569c5fd6440 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:53.863842 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-654822fb-f7d0-44bb-8230-7569c5fd6440 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.813374 Jul 20 11:35:53.876199 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 27/54] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:53 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:35:53.940302 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-368d077c-3dbd-4db9-b6ce-77e90ff5a29e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:53.954047 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-368d077c-3dbd-4db9-b6ce-77e90ff5a29e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.519515 Jul 20 11:35:53.954047 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 28/55] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:53 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:54.137161 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7e5456c0-173f-41ae-97cf-4c564234e49d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:54.141032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7e5456c0-173f-41ae-97cf-4c564234e49d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:54.158745 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e5456c0-173f-41ae-97cf-4c564234e49d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:54.159423 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e5456c0-173f-41ae-97cf-4c564234e49d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:54.161751 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e5456c0-173f-41ae-97cf-4c564234e49d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:54.164126 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e5456c0-173f-41ae-97cf-4c564234e49d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:54.608442 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-61397d54-0ecb-4711-89ca-ffa3a62884ba req-698482ee-a0c0-43b3-bd98-57f1bae3454f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59b4f4f-d49c-4d6b-be00-331cddb9bfc2", "tag": "ca7da8b0-f849-4241-9124-9a117850f9e8"}, {"name": "network-changed", "server_uuid": "e19a7062-f17c-4693-9941-040c456d9bcf", "tag": "823be959-4c3b-4ce0-9838-c80d65b626cf"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:54.639972 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-61397d54-0ecb-4711-89ca-ffa3a62884ba req-698482ee-a0c0-43b3-bd98-57f1bae3454f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:54.640523 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-61397d54-0ecb-4711-89ca-ffa3a62884ba req-698482ee-a0c0-43b3-bd98-57f1bae3454f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:54.667119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-61397d54-0ecb-4711-89ca-ffa3a62884ba req-698482ee-a0c0-43b3-bd98-57f1bae3454f service nova] Creating event network-changed:ca7da8b0-f849-4241-9124-9a117850f9e8 for instance e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 on hv-cinder-82282 Jul 20 11:35:54.667702 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-61397d54-0ecb-4711-89ca-ffa3a62884ba req-698482ee-a0c0-43b3-bd98-57f1bae3454f service nova] Creating event network-changed:823be959-4c3b-4ce0-9838-c80d65b626cf for instance e19a7062-f17c-4693-9941-040c456d9bcf on hv-cinder-82282 Jul 20 11:35:54.696654 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-61397d54-0ecb-4711-89ca-ffa3a62884ba req-698482ee-a0c0-43b3-bd98-57f1bae3454f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.084007 Jul 20 11:35:54.696654 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:35:54.837715 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7e5456c0-173f-41ae-97cf-4c564234e49d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:54.854766 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7e5456c0-173f-41ae-97cf-4c564234e49d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.723264 Jul 20 11:35:54.864251 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 28/57] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:54 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:54.881770 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-04b25926-48e9-4162-93ad-28a039153412 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:54.882527 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-04b25926-48e9-4162-93ad-28a039153412 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:54.896222 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:54.902340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04b25926-48e9-4162-93ad-28a039153412 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:54.902340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04b25926-48e9-4162-93ad-28a039153412 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:54.902340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04b25926-48e9-4162-93ad-28a039153412 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:54.912932 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04b25926-48e9-4162-93ad-28a039153412 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:54.972161 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-41aa1bcb-6651-4e2a-a716-13076c39402f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:54.973391 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-41aa1bcb-6651-4e2a-a716-13076c39402f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:54.983364 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-41aa1bcb-6651-4e2a-a716-13076c39402f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:54.983364 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-41aa1bcb-6651-4e2a-a716-13076c39402f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:54.985849 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-41aa1bcb-6651-4e2a-a716-13076c39402f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:54.986508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-41aa1bcb-6651-4e2a-a716-13076c39402f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:55.850879 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-04b25926-48e9-4162-93ad-28a039153412 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:55.861619 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-41aa1bcb-6651-4e2a-a716-13076c39402f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:55.870242 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-04b25926-48e9-4162-93ad-28a039153412 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.992633 Jul 20 11:35:55.870876 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 30/58] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:54 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:55.875589 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-41aa1bcb-6651-4e2a-a716-13076c39402f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.907228 Jul 20 11:35:55.877603 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 29/59] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:54 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:35:55.886758 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-36c80e8d-33d0-42b8-b6ec-29c10e3a95c5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:55.892991 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-36c80e8d-33d0-42b8-b6ec-29c10e3a95c5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:55.894364 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36c80e8d-33d0-42b8-b6ec-29c10e3a95c5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:55.895231 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36c80e8d-33d0-42b8-b6ec-29c10e3a95c5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:55.896182 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36c80e8d-33d0-42b8-b6ec-29c10e3a95c5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:55.896819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-36c80e8d-33d0-42b8-b6ec-29c10e3a95c5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:56.104601 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-36c80e8d-33d0-42b8-b6ec-29c10e3a95c5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:56.113045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-36c80e8d-33d0-42b8-b6ec-29c10e3a95c5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.230804 Jul 20 11:35:56.113874 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 31/60] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:55 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:56.887642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e8899e0-c93d-4649-a9d3-4bb1fea78941 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:56.888289 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2e8899e0-c93d-4649-a9d3-4bb1fea78941 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:56.892931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:56.903915 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-13ef3e23-b249-4c51-98f3-ab6cf92e8ac0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:56.904521 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-13ef3e23-b249-4c51-98f3-ab6cf92e8ac0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:56.906750 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e8899e0-c93d-4649-a9d3-4bb1fea78941 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:56.907370 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e8899e0-c93d-4649-a9d3-4bb1fea78941 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:56.908161 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e8899e0-c93d-4649-a9d3-4bb1fea78941 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:56.908681 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e8899e0-c93d-4649-a9d3-4bb1fea78941 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:56.910903 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13ef3e23-b249-4c51-98f3-ab6cf92e8ac0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:56.911372 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13ef3e23-b249-4c51-98f3-ab6cf92e8ac0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:56.912147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13ef3e23-b249-4c51-98f3-ab6cf92e8ac0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:56.912745 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13ef3e23-b249-4c51-98f3-ab6cf92e8ac0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:57.137382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2e8899e0-c93d-4649-a9d3-4bb1fea78941 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:57.144844 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2e8899e0-c93d-4649-a9d3-4bb1fea78941 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.261309 Jul 20 11:35:57.145502 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 30/61] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:56 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:57.149957 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-31dc2bf1-0ea8-49fa-ac56-402b3c6ad3c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:57.150623 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-31dc2bf1-0ea8-49fa-ac56-402b3c6ad3c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:57.156381 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31dc2bf1-0ea8-49fa-ac56-402b3c6ad3c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:57.156933 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31dc2bf1-0ea8-49fa-ac56-402b3c6ad3c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:57.157859 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31dc2bf1-0ea8-49fa-ac56-402b3c6ad3c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:57.158413 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-31dc2bf1-0ea8-49fa-ac56-402b3c6ad3c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:57.170845 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-13ef3e23-b249-4c51-98f3-ab6cf92e8ac0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:57.178911 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-13ef3e23-b249-4c51-98f3-ab6cf92e8ac0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.288694 Jul 20 11:35:57.179481 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 32/62] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:56 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:35:57.522794 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-31dc2bf1-0ea8-49fa-ac56-402b3c6ad3c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:57.530973 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-31dc2bf1-0ea8-49fa-ac56-402b3c6ad3c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.384437 Jul 20 11:35:57.545452 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 31/63] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:57 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:58.161103 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-77f5b159-6a8d-491c-a833-00df8fe0657b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:58.161718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-77f5b159-6a8d-491c-a833-00df8fe0657b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:58.167768 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77f5b159-6a8d-491c-a833-00df8fe0657b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:58.169808 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77f5b159-6a8d-491c-a833-00df8fe0657b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:58.169808 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77f5b159-6a8d-491c-a833-00df8fe0657b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:58.169808 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77f5b159-6a8d-491c-a833-00df8fe0657b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:58.196067 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-29ef5170-dfb8-4585-83b4-c6c8390b4c97 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:58.200231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-29ef5170-dfb8-4585-83b4-c6c8390b4c97 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:58.203851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29ef5170-dfb8-4585-83b4-c6c8390b4c97 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:58.204381 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29ef5170-dfb8-4585-83b4-c6c8390b4c97 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:58.205261 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29ef5170-dfb8-4585-83b4-c6c8390b4c97 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:58.205956 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-29ef5170-dfb8-4585-83b4-c6c8390b4c97 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:58.380495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-77f5b159-6a8d-491c-a833-00df8fe0657b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:58.390355 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-77f5b159-6a8d-491c-a833-00df8fe0657b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.233144 Jul 20 11:35:58.391990 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 33/64] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:58 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:58.424639 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-29ef5170-dfb8-4585-83b4-c6c8390b4c97 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:58.433784 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-29ef5170-dfb8-4585-83b4-c6c8390b4c97 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.242101 Jul 20 11:35:58.434363 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 32/65] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:58 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:58.549429 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-070f290a-22a8-47ba-b6d0-262984a7d9ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:58.550074 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-070f290a-22a8-47ba-b6d0-262984a7d9ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:58.557383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-070f290a-22a8-47ba-b6d0-262984a7d9ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:58.558081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-070f290a-22a8-47ba-b6d0-262984a7d9ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:58.559018 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-070f290a-22a8-47ba-b6d0-262984a7d9ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:58.559610 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-070f290a-22a8-47ba-b6d0-262984a7d9ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:58.695395 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-070f290a-22a8-47ba-b6d0-262984a7d9ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:58.702697 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-070f290a-22a8-47ba-b6d0-262984a7d9ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.158154 Jul 20 11:35:58.703261 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 34/66] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:58 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:59.408175 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1db53afa-f34e-4b26-a27a-a5808974b549 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:59.408805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1db53afa-f34e-4b26-a27a-a5808974b549 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:59.415153 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1db53afa-f34e-4b26-a27a-a5808974b549 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:59.415597 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1db53afa-f34e-4b26-a27a-a5808974b549 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:59.416362 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1db53afa-f34e-4b26-a27a-a5808974b549 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:59.416822 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1db53afa-f34e-4b26-a27a-a5808974b549 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:59.451534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d64398cc-9a33-41b1-8bdb-9205e301446c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:59.452517 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d64398cc-9a33-41b1-8bdb-9205e301446c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:59.459204 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d64398cc-9a33-41b1-8bdb-9205e301446c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:59.459658 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d64398cc-9a33-41b1-8bdb-9205e301446c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:59.460432 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d64398cc-9a33-41b1-8bdb-9205e301446c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:59.460896 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d64398cc-9a33-41b1-8bdb-9205e301446c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:59.608287 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1db53afa-f34e-4b26-a27a-a5808974b549 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:59.616270 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1db53afa-f34e-4b26-a27a-a5808974b549 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.212006 Jul 20 11:35:59.617004 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 33/67] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:59 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:59.634874 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d64398cc-9a33-41b1-8bdb-9205e301446c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:59.642374 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d64398cc-9a33-41b1-8bdb-9205e301446c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.195275 Jul 20 11:35:59.645458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 35/68] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:59 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:59.719431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a0eb4fae-8b0a-406d-92f4-7f49fccf3a94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:59.720016 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a0eb4fae-8b0a-406d-92f4-7f49fccf3a94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:59.726028 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0eb4fae-8b0a-406d-92f4-7f49fccf3a94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:59.726591 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0eb4fae-8b0a-406d-92f4-7f49fccf3a94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:59.727393 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0eb4fae-8b0a-406d-92f4-7f49fccf3a94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:59.727826 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0eb4fae-8b0a-406d-92f4-7f49fccf3a94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:59.861774 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a0eb4fae-8b0a-406d-92f4-7f49fccf3a94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:59.869329 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a0eb4fae-8b0a-406d-92f4-7f49fccf3a94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.153700 Jul 20 11:35:59.869902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 34/69] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:59 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:00.636358 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-228dcb5a-eb8d-4584-b1c8-33a27c814ef1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:00.636940 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-228dcb5a-eb8d-4584-b1c8-33a27c814ef1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:00.639766 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:00.643443 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-228dcb5a-eb8d-4584-b1c8-33a27c814ef1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:00.644080 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-228dcb5a-eb8d-4584-b1c8-33a27c814ef1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:00.653268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-228dcb5a-eb8d-4584-b1c8-33a27c814ef1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:00.653268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-228dcb5a-eb8d-4584-b1c8-33a27c814ef1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:00.661271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ab35d9f1-9457-4bc1-b078-86fef2e4a049 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:00.662449 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ab35d9f1-9457-4bc1-b078-86fef2e4a049 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:00.668753 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab35d9f1-9457-4bc1-b078-86fef2e4a049 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:00.669425 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab35d9f1-9457-4bc1-b078-86fef2e4a049 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:00.670566 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab35d9f1-9457-4bc1-b078-86fef2e4a049 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:00.671192 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab35d9f1-9457-4bc1-b078-86fef2e4a049 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:00.856822 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-228dcb5a-eb8d-4584-b1c8-33a27c814ef1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:00.860639 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ab35d9f1-9457-4bc1-b078-86fef2e4a049 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:00.864407 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-228dcb5a-eb8d-4584-b1c8-33a27c814ef1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.234904 Jul 20 11:36:00.865013 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 36/70] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:00 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:00.880502 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ab35d9f1-9457-4bc1-b078-86fef2e4a049 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.217288 Jul 20 11:36:00.880502 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 35/71] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:00 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:00.886834 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-918a9ec7-95ca-4233-aebb-8fa0819daaa2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:00.887383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-918a9ec7-95ca-4233-aebb-8fa0819daaa2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:00.893304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-918a9ec7-95ca-4233-aebb-8fa0819daaa2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:00.893757 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-918a9ec7-95ca-4233-aebb-8fa0819daaa2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:00.894522 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-918a9ec7-95ca-4233-aebb-8fa0819daaa2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:00.894974 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-918a9ec7-95ca-4233-aebb-8fa0819daaa2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:01.208739 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-918a9ec7-95ca-4233-aebb-8fa0819daaa2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:01.216597 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-918a9ec7-95ca-4233-aebb-8fa0819daaa2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.333837 Jul 20 11:36:01.217298 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 37/72] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:00 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:01.882569 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cb6e36c9-cc75-436c-97f0-96897d10ca6a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:01.883442 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cb6e36c9-cc75-436c-97f0-96897d10ca6a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:01.889786 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb6e36c9-cc75-436c-97f0-96897d10ca6a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:01.890451 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb6e36c9-cc75-436c-97f0-96897d10ca6a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:01.891410 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb6e36c9-cc75-436c-97f0-96897d10ca6a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:01.891925 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb6e36c9-cc75-436c-97f0-96897d10ca6a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:01.895532 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8998630c-38c7-438c-b065-b34c0f997b1a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:01.898574 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8998630c-38c7-438c-b065-b34c0f997b1a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:01.903217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8998630c-38c7-438c-b065-b34c0f997b1a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:01.903686 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8998630c-38c7-438c-b065-b34c0f997b1a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:01.904453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8998630c-38c7-438c-b065-b34c0f997b1a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:01.904915 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8998630c-38c7-438c-b065-b34c0f997b1a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:02.097975 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cb6e36c9-cc75-436c-97f0-96897d10ca6a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:02.098206 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8998630c-38c7-438c-b065-b34c0f997b1a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:02.101631 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cb6e36c9-cc75-436c-97f0-96897d10ca6a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.223696 Jul 20 11:36:02.102518 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 36/73] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:01 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:02.104953 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8998630c-38c7-438c-b065-b34c0f997b1a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.213096 Jul 20 11:36:02.105511 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 38/74] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:01 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:02.234058 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b9dca18c-edce-4cb0-96b1-df8522b61559 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:02.235028 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b9dca18c-edce-4cb0-96b1-df8522b61559 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:02.241743 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9dca18c-edce-4cb0-96b1-df8522b61559 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:02.242376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9dca18c-edce-4cb0-96b1-df8522b61559 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:02.243134 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9dca18c-edce-4cb0-96b1-df8522b61559 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:02.243598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b9dca18c-edce-4cb0-96b1-df8522b61559 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:02.371764 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b9dca18c-edce-4cb0-96b1-df8522b61559 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:02.379095 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b9dca18c-edce-4cb0-96b1-df8522b61559 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.148916 Jul 20 11:36:02.383242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 37/75] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:02 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:03.118958 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fb245cf0-074a-42ab-ac23-3b7afe9b9a27 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:03.119560 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fb245cf0-074a-42ab-ac23-3b7afe9b9a27 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:03.122506 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-49d5ca07-08ee-4c61-84ca-742c7cb51c70 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:03.122894 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-49d5ca07-08ee-4c61-84ca-742c7cb51c70 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:03.124493 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:03.125516 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb245cf0-074a-42ab-ac23-3b7afe9b9a27 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:03.125956 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb245cf0-074a-42ab-ac23-3b7afe9b9a27 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:03.126710 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb245cf0-074a-42ab-ac23-3b7afe9b9a27 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:03.127137 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb245cf0-074a-42ab-ac23-3b7afe9b9a27 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:03.129403 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49d5ca07-08ee-4c61-84ca-742c7cb51c70 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:03.129860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49d5ca07-08ee-4c61-84ca-742c7cb51c70 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:03.130621 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49d5ca07-08ee-4c61-84ca-742c7cb51c70 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:03.131686 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49d5ca07-08ee-4c61-84ca-742c7cb51c70 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:03.325613 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fb245cf0-074a-42ab-ac23-3b7afe9b9a27 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:03.334481 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-49d5ca07-08ee-4c61-84ca-742c7cb51c70 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:03.334834 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fb245cf0-074a-42ab-ac23-3b7afe9b9a27 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.218886 Jul 20 11:36:03.334834 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 39/76] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:03 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:03.339378 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-49d5ca07-08ee-4c61-84ca-742c7cb51c70 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.221084 Jul 20 11:36:03.339972 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 38/77] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:03 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:03.395682 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3b1877a4-863b-456a-9693-fdb77480c087 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:03.396309 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3b1877a4-863b-456a-9693-fdb77480c087 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:03.402268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b1877a4-863b-456a-9693-fdb77480c087 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:03.402714 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b1877a4-863b-456a-9693-fdb77480c087 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:03.403471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b1877a4-863b-456a-9693-fdb77480c087 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:03.403907 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b1877a4-863b-456a-9693-fdb77480c087 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:03.535084 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3b1877a4-863b-456a-9693-fdb77480c087 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:03.543381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3b1877a4-863b-456a-9693-fdb77480c087 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.151461 Jul 20 11:36:03.544222 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 40/78] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:03 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:04.350452 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d7ba0ae-56d0-46ec-84f3-2a64bbe6f685 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:04.351028 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2d7ba0ae-56d0-46ec-84f3-2a64bbe6f685 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:04.356221 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5031e02b-f80a-4e71-81ca-a4e5c478b4ca tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:04.357165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5031e02b-f80a-4e71-81ca-a4e5c478b4ca tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:04.357292 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d7ba0ae-56d0-46ec-84f3-2a64bbe6f685 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:04.357744 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d7ba0ae-56d0-46ec-84f3-2a64bbe6f685 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:04.358505 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d7ba0ae-56d0-46ec-84f3-2a64bbe6f685 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:04.359124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d7ba0ae-56d0-46ec-84f3-2a64bbe6f685 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:04.363833 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5031e02b-f80a-4e71-81ca-a4e5c478b4ca tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:04.364287 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5031e02b-f80a-4e71-81ca-a4e5c478b4ca tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:04.365094 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5031e02b-f80a-4e71-81ca-a4e5c478b4ca tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:04.365537 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5031e02b-f80a-4e71-81ca-a4e5c478b4ca tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:04.563944 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d7ba0ae-56d0-46ec-84f3-2a64bbe6f685 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:04.566242 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5031e02b-f80a-4e71-81ca-a4e5c478b4ca tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:04.570628 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2d7ba0ae-56d0-46ec-84f3-2a64bbe6f685 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.223991 Jul 20 11:36:04.571205 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 39/79] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:04 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:04.574046 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5031e02b-f80a-4e71-81ca-a4e5c478b4ca tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.221705 Jul 20 11:36:04.574607 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 41/80] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:04 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:04.576182 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-95410e28-b81b-475a-8632-5452c2e23a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:04.576929 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-95410e28-b81b-475a-8632-5452c2e23a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:04.583343 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95410e28-b81b-475a-8632-5452c2e23a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:04.583794 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95410e28-b81b-475a-8632-5452c2e23a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:04.584600 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95410e28-b81b-475a-8632-5452c2e23a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:04.585059 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-95410e28-b81b-475a-8632-5452c2e23a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:04.730384 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-95410e28-b81b-475a-8632-5452c2e23a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:04.741307 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-95410e28-b81b-475a-8632-5452c2e23a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.168398 Jul 20 11:36:04.741891 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 40/81] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:04 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:05.588057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c824e595-8586-4293-bea3-71f46fc522d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:05.588757 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c824e595-8586-4293-bea3-71f46fc522d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:05.590994 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f9ecd224-d408-4696-844e-6ceae95a916f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:05.591605 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f9ecd224-d408-4696-844e-6ceae95a916f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:05.595023 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c824e595-8586-4293-bea3-71f46fc522d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:05.595471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c824e595-8586-4293-bea3-71f46fc522d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:05.596238 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c824e595-8586-4293-bea3-71f46fc522d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:05.596668 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c824e595-8586-4293-bea3-71f46fc522d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:05.597577 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9ecd224-d408-4696-844e-6ceae95a916f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:05.598025 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9ecd224-d408-4696-844e-6ceae95a916f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:05.598815 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9ecd224-d408-4696-844e-6ceae95a916f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:05.599249 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f9ecd224-d408-4696-844e-6ceae95a916f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:05.791673 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c824e595-8586-4293-bea3-71f46fc522d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:05.798501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f9ecd224-d408-4696-844e-6ceae95a916f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:05.799035 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c824e595-8586-4293-bea3-71f46fc522d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.215415 Jul 20 11:36:05.799607 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 42/82] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:05 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:05.807730 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b17ab0ea-2ff0-44bd-a049-fcd2ed6c7a73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:05.807730 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b17ab0ea-2ff0-44bd-a049-fcd2ed6c7a73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:05.809417 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f9ecd224-d408-4696-844e-6ceae95a916f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.219589 Jul 20 11:36:05.809417 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 41/83] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:05 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:05.810377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b17ab0ea-2ff0-44bd-a049-fcd2ed6c7a73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:05.810824 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b17ab0ea-2ff0-44bd-a049-fcd2ed6c7a73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:05.811621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b17ab0ea-2ff0-44bd-a049-fcd2ed6c7a73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:05.812058 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b17ab0ea-2ff0-44bd-a049-fcd2ed6c7a73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:05.830058 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:05.945349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b17ab0ea-2ff0-44bd-a049-fcd2ed6c7a73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:05.952616 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b17ab0ea-2ff0-44bd-a049-fcd2ed6c7a73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.152082 Jul 20 11:36:05.953202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 43/84] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:05 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:06.820631 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75f081c5-1313-4dbe-80b3-13ea88242cd6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:06.820631 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75f081c5-1313-4dbe-80b3-13ea88242cd6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:06.823922 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75f081c5-1313-4dbe-80b3-13ea88242cd6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:06.824375 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75f081c5-1313-4dbe-80b3-13ea88242cd6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:06.825180 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75f081c5-1313-4dbe-80b3-13ea88242cd6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:06.825618 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75f081c5-1313-4dbe-80b3-13ea88242cd6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:06.826179 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4b9058f5-ad0c-4fa9-8f03-5e98fb96ee1c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:06.827305 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4b9058f5-ad0c-4fa9-8f03-5e98fb96ee1c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:06.838184 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b9058f5-ad0c-4fa9-8f03-5e98fb96ee1c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:06.838184 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b9058f5-ad0c-4fa9-8f03-5e98fb96ee1c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:06.838184 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b9058f5-ad0c-4fa9-8f03-5e98fb96ee1c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:06.838184 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b9058f5-ad0c-4fa9-8f03-5e98fb96ee1c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:07.018839 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-75f081c5-1313-4dbe-80b3-13ea88242cd6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:07.022435 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:07.023249 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4b9058f5-ad0c-4fa9-8f03-5e98fb96ee1c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:07.027432 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75f081c5-1313-4dbe-80b3-13ea88242cd6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.215457 Jul 20 11:36:07.028010 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 42/85] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:06 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:07.030516 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4b9058f5-ad0c-4fa9-8f03-5e98fb96ee1c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.210996 Jul 20 11:36:07.031070 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 44/86] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:06 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:07.032384 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ce9c8f99-56a2-435b-91ac-08f0eb5d7705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:07.033029 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ce9c8f99-56a2-435b-91ac-08f0eb5d7705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:07.039281 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce9c8f99-56a2-435b-91ac-08f0eb5d7705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:07.039733 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce9c8f99-56a2-435b-91ac-08f0eb5d7705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:07.040506 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce9c8f99-56a2-435b-91ac-08f0eb5d7705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:07.040974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce9c8f99-56a2-435b-91ac-08f0eb5d7705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:07.171653 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ce9c8f99-56a2-435b-91ac-08f0eb5d7705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:07.178973 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ce9c8f99-56a2-435b-91ac-08f0eb5d7705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.150025 Jul 20 11:36:07.179543 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 43/87] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:07 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:08.043946 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aab3fb35-68ea-4fd4-a1d2-029ae41878e0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:08.044593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aab3fb35-68ea-4fd4-a1d2-029ae41878e0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:08.047090 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7de5b91a-7eb7-495c-94a6-c23236a4b0d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:08.047697 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7de5b91a-7eb7-495c-94a6-c23236a4b0d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:08.050804 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aab3fb35-68ea-4fd4-a1d2-029ae41878e0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:08.051247 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aab3fb35-68ea-4fd4-a1d2-029ae41878e0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:08.052003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aab3fb35-68ea-4fd4-a1d2-029ae41878e0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:08.052431 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aab3fb35-68ea-4fd4-a1d2-029ae41878e0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:08.053509 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7de5b91a-7eb7-495c-94a6-c23236a4b0d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:08.054542 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7de5b91a-7eb7-495c-94a6-c23236a4b0d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:08.055321 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7de5b91a-7eb7-495c-94a6-c23236a4b0d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:08.055720 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7de5b91a-7eb7-495c-94a6-c23236a4b0d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:08.247961 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aab3fb35-68ea-4fd4-a1d2-029ae41878e0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:08.252190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7de5b91a-7eb7-495c-94a6-c23236a4b0d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:08.255983 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aab3fb35-68ea-4fd4-a1d2-029ae41878e0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.215816 Jul 20 11:36:08.256564 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 45/88] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:08 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:08.261314 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0587f978-9e36-4d11-a076-bfa0d8f966da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:08.261917 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0587f978-9e36-4d11-a076-bfa0d8f966da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:08.267548 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0587f978-9e36-4d11-a076-bfa0d8f966da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:08.267993 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0587f978-9e36-4d11-a076-bfa0d8f966da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:08.268348 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7de5b91a-7eb7-495c-94a6-c23236a4b0d1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.224922 Jul 20 11:36:08.268754 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0587f978-9e36-4d11-a076-bfa0d8f966da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:08.281146 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 44/89] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:08 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:08.281259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0587f978-9e36-4d11-a076-bfa0d8f966da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:08.394714 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0587f978-9e36-4d11-a076-bfa0d8f966da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:08.402691 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0587f978-9e36-4d11-a076-bfa0d8f966da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.145114 Jul 20 11:36:08.403250 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 46/90] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:08 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:09.273454 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2dd4fea2-db9f-42d6-9a4b-383ac7e7bc89 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:09.274064 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2dd4fea2-db9f-42d6-9a4b-383ac7e7bc89 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:09.280005 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2dd4fea2-db9f-42d6-9a4b-383ac7e7bc89 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:09.280450 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2dd4fea2-db9f-42d6-9a4b-383ac7e7bc89 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:09.281243 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2dd4fea2-db9f-42d6-9a4b-383ac7e7bc89 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:09.281674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2dd4fea2-db9f-42d6-9a4b-383ac7e7bc89 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:09.297281 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9eb7d83b-644b-4cc6-adcb-305b7366931a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:09.302095 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9eb7d83b-644b-4cc6-adcb-305b7366931a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:09.306458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9eb7d83b-644b-4cc6-adcb-305b7366931a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:09.306902 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9eb7d83b-644b-4cc6-adcb-305b7366931a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:09.307663 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9eb7d83b-644b-4cc6-adcb-305b7366931a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:09.308207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9eb7d83b-644b-4cc6-adcb-305b7366931a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:09.502299 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2dd4fea2-db9f-42d6-9a4b-383ac7e7bc89 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:09.506621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9eb7d83b-644b-4cc6-adcb-305b7366931a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:09.516976 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9eb7d83b-644b-4cc6-adcb-305b7366931a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.223997 Jul 20 11:36:09.517193 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2dd4fea2-db9f-42d6-9a4b-383ac7e7bc89 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.247601 Jul 20 11:36:09.517788 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 45/91] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:09 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:09.526580 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-35c933ff-22c9-4689-9147-5d10bdc63ab9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:09.526580 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-35c933ff-22c9-4689-9147-5d10bdc63ab9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:09.527062 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 47/92] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:09 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:09.530704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35c933ff-22c9-4689-9147-5d10bdc63ab9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:09.530704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35c933ff-22c9-4689-9147-5d10bdc63ab9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:09.530704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35c933ff-22c9-4689-9147-5d10bdc63ab9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:09.531140 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35c933ff-22c9-4689-9147-5d10bdc63ab9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:09.662089 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-35c933ff-22c9-4689-9147-5d10bdc63ab9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:09.669916 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-35c933ff-22c9-4689-9147-5d10bdc63ab9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.151182 Jul 20 11:36:09.673992 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 46/93] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:09 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:10.534354 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-738c6cb2-acca-4c6a-ba28-9d7a4f9f8120 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:10.534992 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-738c6cb2-acca-4c6a-ba28-9d7a4f9f8120 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:10.536740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bb3536e4-ea54-4b02-8623-dbdf26acf536 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:10.537392 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bb3536e4-ea54-4b02-8623-dbdf26acf536 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:10.541778 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-738c6cb2-acca-4c6a-ba28-9d7a4f9f8120 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:10.542220 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-738c6cb2-acca-4c6a-ba28-9d7a4f9f8120 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:10.543066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-738c6cb2-acca-4c6a-ba28-9d7a4f9f8120 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:10.543499 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-738c6cb2-acca-4c6a-ba28-9d7a4f9f8120 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:10.543594 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb3536e4-ea54-4b02-8623-dbdf26acf536 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:10.543947 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb3536e4-ea54-4b02-8623-dbdf26acf536 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:10.544713 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb3536e4-ea54-4b02-8623-dbdf26acf536 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:10.545174 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bb3536e4-ea54-4b02-8623-dbdf26acf536 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:10.738376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-738c6cb2-acca-4c6a-ba28-9d7a4f9f8120 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:10.743193 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bb3536e4-ea54-4b02-8623-dbdf26acf536 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:10.747286 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-738c6cb2-acca-4c6a-ba28-9d7a4f9f8120 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.217276 Jul 20 11:36:10.756708 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 48/94] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:10 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:10.756901 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bb3536e4-ea54-4b02-8623-dbdf26acf536 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.218544 Jul 20 11:36:10.756901 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 47/95] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:10 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:10.763413 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5fa310be-ad2e-49ce-a748-808ee2fb79f5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:10.764024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5fa310be-ad2e-49ce-a748-808ee2fb79f5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:10.770070 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5fa310be-ad2e-49ce-a748-808ee2fb79f5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:10.770513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5fa310be-ad2e-49ce-a748-808ee2fb79f5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:10.771304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5fa310be-ad2e-49ce-a748-808ee2fb79f5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:10.771732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5fa310be-ad2e-49ce-a748-808ee2fb79f5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:10.906058 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5fa310be-ad2e-49ce-a748-808ee2fb79f5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:10.908392 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5fa310be-ad2e-49ce-a748-808ee2fb79f5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.159559 Jul 20 11:36:10.909173 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 49/96] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:10 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:11.765049 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-45f83ebc-9215-4b5d-9479-411ac7ebdb9f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:11.765677 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-45f83ebc-9215-4b5d-9479-411ac7ebdb9f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:11.769961 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-55299c0c-05f4-4c4f-ba14-9a9a804fff53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:11.769961 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-55299c0c-05f4-4c4f-ba14-9a9a804fff53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:11.772355 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45f83ebc-9215-4b5d-9479-411ac7ebdb9f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:11.772830 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45f83ebc-9215-4b5d-9479-411ac7ebdb9f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:11.774474 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45f83ebc-9215-4b5d-9479-411ac7ebdb9f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:11.774657 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45f83ebc-9215-4b5d-9479-411ac7ebdb9f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:11.779877 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55299c0c-05f4-4c4f-ba14-9a9a804fff53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:11.779877 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55299c0c-05f4-4c4f-ba14-9a9a804fff53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:11.779877 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55299c0c-05f4-4c4f-ba14-9a9a804fff53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:11.780192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55299c0c-05f4-4c4f-ba14-9a9a804fff53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:11.973772 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45f83ebc-9215-4b5d-9479-411ac7ebdb9f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:11.977088 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-55299c0c-05f4-4c4f-ba14-9a9a804fff53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:11.981424 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-45f83ebc-9215-4b5d-9479-411ac7ebdb9f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.220558 Jul 20 11:36:11.982180 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 48/97] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:11 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:11.984700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-55299c0c-05f4-4c4f-ba14-9a9a804fff53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.219227 Jul 20 11:36:11.990339 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 50/98] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:11 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:11.990490 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8b115f6-aff6-495b-8831-295faa4096db tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:11.990490 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a8b115f6-aff6-495b-8831-295faa4096db tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:11.994586 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8b115f6-aff6-495b-8831-295faa4096db tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:11.995043 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8b115f6-aff6-495b-8831-295faa4096db tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:11.995823 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8b115f6-aff6-495b-8831-295faa4096db tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:11.996263 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8b115f6-aff6-495b-8831-295faa4096db tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:12.137964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a8b115f6-aff6-495b-8831-295faa4096db tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:12.145223 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a8b115f6-aff6-495b-8831-295faa4096db tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.162042 Jul 20 11:36:12.145777 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 49/99] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:11 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:13.000461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e6ddbcad-c8b9-442b-8949-d84a3c59ec39 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:13.001089 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e6ddbcad-c8b9-442b-8949-d84a3c59ec39 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:13.002467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-562b478a-a516-4473-8038-66bb87ad46dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:13.003251 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-562b478a-a516-4473-8038-66bb87ad46dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:13.008857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6ddbcad-c8b9-442b-8949-d84a3c59ec39 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:13.009334 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6ddbcad-c8b9-442b-8949-d84a3c59ec39 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:13.013708 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6ddbcad-c8b9-442b-8949-d84a3c59ec39 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:13.013810 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-562b478a-a516-4473-8038-66bb87ad46dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:13.013908 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6ddbcad-c8b9-442b-8949-d84a3c59ec39 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:13.013982 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-562b478a-a516-4473-8038-66bb87ad46dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:13.013982 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-562b478a-a516-4473-8038-66bb87ad46dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:13.013982 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-562b478a-a516-4473-8038-66bb87ad46dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:13.248020 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-562b478a-a516-4473-8038-66bb87ad46dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:13.255637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-562b478a-a516-4473-8038-66bb87ad46dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.256930 Jul 20 11:36:13.256208 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 50/100] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:12 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:13.261177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5aeabc8f-d3e2-43f2-9a68-da42efb96265 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:13.261958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5aeabc8f-d3e2-43f2-9a68-da42efb96265 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:13.267790 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5aeabc8f-d3e2-43f2-9a68-da42efb96265 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:13.268240 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5aeabc8f-d3e2-43f2-9a68-da42efb96265 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:13.269269 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5aeabc8f-d3e2-43f2-9a68-da42efb96265 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:13.269709 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5aeabc8f-d3e2-43f2-9a68-da42efb96265 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:13.270148 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e6ddbcad-c8b9-442b-8949-d84a3c59ec39 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:13.279190 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e6ddbcad-c8b9-442b-8949-d84a3c59ec39 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.283234 Jul 20 11:36:13.288952 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 51/101] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:12 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:13.437383 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5aeabc8f-d3e2-43f2-9a68-da42efb96265 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:13.445352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5aeabc8f-d3e2-43f2-9a68-da42efb96265 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.188178 Jul 20 11:36:13.445917 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 51/102] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:13 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:14.273338 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2e87c457-76a3-4b74-b075-3da61cccfcb3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:14.273985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2e87c457-76a3-4b74-b075-3da61cccfcb3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:14.279921 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e87c457-76a3-4b74-b075-3da61cccfcb3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:14.280446 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e87c457-76a3-4b74-b075-3da61cccfcb3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:14.281373 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e87c457-76a3-4b74-b075-3da61cccfcb3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:14.281821 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e87c457-76a3-4b74-b075-3da61cccfcb3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:14.295448 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e6e6a947-1399-4738-8ff1-331ba9291bec tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:14.296671 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e6e6a947-1399-4738-8ff1-331ba9291bec tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:14.302614 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6e6a947-1399-4738-8ff1-331ba9291bec tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:14.303059 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6e6a947-1399-4738-8ff1-331ba9291bec tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:14.303810 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6e6a947-1399-4738-8ff1-331ba9291bec tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:14.304241 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6e6a947-1399-4738-8ff1-331ba9291bec tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:14.481042 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2e87c457-76a3-4b74-b075-3da61cccfcb3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:14.487533 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e6e6a947-1399-4738-8ff1-331ba9291bec tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:14.488414 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2e87c457-76a3-4b74-b075-3da61cccfcb3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.218881 Jul 20 11:36:14.489043 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 52/103] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:14 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:14.494251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9e56152d-4202-4e4d-ab2f-ce700e7c8252 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:14.494852 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9e56152d-4202-4e4d-ab2f-ce700e7c8252 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:14.495737 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e6e6a947-1399-4738-8ff1-331ba9291bec tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.204035 Jul 20 11:36:14.496483 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 52/104] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:14 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:14.500880 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e56152d-4202-4e4d-ab2f-ce700e7c8252 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:14.501331 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e56152d-4202-4e4d-ab2f-ce700e7c8252 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:14.503241 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e56152d-4202-4e4d-ab2f-ce700e7c8252 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:14.503241 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e56152d-4202-4e4d-ab2f-ce700e7c8252 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:14.685879 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9e56152d-4202-4e4d-ab2f-ce700e7c8252 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:14.693716 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9e56152d-4202-4e4d-ab2f-ce700e7c8252 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.203666 Jul 20 11:36:14.700994 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 53/105] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:14 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:15.505127 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3587d4ac-e163-47a6-af04-617ff923c405 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:15.506912 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3587d4ac-e163-47a6-af04-617ff923c405 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:15.515400 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3587d4ac-e163-47a6-af04-617ff923c405 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:15.516129 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3587d4ac-e163-47a6-af04-617ff923c405 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:15.517175 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3587d4ac-e163-47a6-af04-617ff923c405 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:15.517811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3587d4ac-e163-47a6-af04-617ff923c405 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:15.519881 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0c46c545-d109-4f61-b46e-8913bc22d62b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:15.521107 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0c46c545-d109-4f61-b46e-8913bc22d62b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:15.529280 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c46c545-d109-4f61-b46e-8913bc22d62b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:15.529906 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c46c545-d109-4f61-b46e-8913bc22d62b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:15.530707 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c46c545-d109-4f61-b46e-8913bc22d62b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:15.531098 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c46c545-d109-4f61-b46e-8913bc22d62b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:15.723985 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3587d4ac-e163-47a6-af04-617ff923c405 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:15.726541 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0c46c545-d109-4f61-b46e-8913bc22d62b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:15.731389 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3587d4ac-e163-47a6-af04-617ff923c405 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.230070 Jul 20 11:36:15.732307 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 53/106] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:15 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:15.737076 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6f02ac8d-1451-4844-abb8-3f3edeb8d1ee tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:15.738004 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6f02ac8d-1451-4844-abb8-3f3edeb8d1ee tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:15.739047 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0c46c545-d109-4f61-b46e-8913bc22d62b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.223612 Jul 20 11:36:15.739619 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 54/107] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:15 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:15.745661 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f02ac8d-1451-4844-abb8-3f3edeb8d1ee tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:15.746105 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f02ac8d-1451-4844-abb8-3f3edeb8d1ee tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:15.746860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f02ac8d-1451-4844-abb8-3f3edeb8d1ee tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:15.747288 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6f02ac8d-1451-4844-abb8-3f3edeb8d1ee tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:15.887827 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6f02ac8d-1451-4844-abb8-3f3edeb8d1ee tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:15.893711 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6f02ac8d-1451-4844-abb8-3f3edeb8d1ee tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.160099 Jul 20 11:36:15.894319 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 54/108] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:15 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:16.747498 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2cff455e-28b7-4e9a-82b2-7414b31fb391 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:16.748224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2cff455e-28b7-4e9a-82b2-7414b31fb391 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:16.754695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cff455e-28b7-4e9a-82b2-7414b31fb391 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:16.755148 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cff455e-28b7-4e9a-82b2-7414b31fb391 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:16.756039 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cff455e-28b7-4e9a-82b2-7414b31fb391 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:16.756482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cff455e-28b7-4e9a-82b2-7414b31fb391 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:16.758418 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1eb4e21f-81f6-4bd2-8672-675458c30d40 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:16.759563 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1eb4e21f-81f6-4bd2-8672-675458c30d40 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:16.766198 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1eb4e21f-81f6-4bd2-8672-675458c30d40 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:16.767233 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1eb4e21f-81f6-4bd2-8672-675458c30d40 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:16.768228 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1eb4e21f-81f6-4bd2-8672-675458c30d40 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:16.768982 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1eb4e21f-81f6-4bd2-8672-675458c30d40 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:17.138376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2cff455e-28b7-4e9a-82b2-7414b31fb391 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:17.142212 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1eb4e21f-81f6-4bd2-8672-675458c30d40 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:17.146202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2cff455e-28b7-4e9a-82b2-7414b31fb391 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.402488 Jul 20 11:36:17.146801 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 55/109] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:16 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:17.150629 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1eb4e21f-81f6-4bd2-8672-675458c30d40 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.396898 Jul 20 11:36:17.151264 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 55/110] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:16 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:17.151993 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7288111d-7509-4ec4-9ce0-4ff48799e829 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:17.152596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7288111d-7509-4ec4-9ce0-4ff48799e829 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:17.158439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7288111d-7509-4ec4-9ce0-4ff48799e829 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:17.158883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7288111d-7509-4ec4-9ce0-4ff48799e829 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:17.159680 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7288111d-7509-4ec4-9ce0-4ff48799e829 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:17.160116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7288111d-7509-4ec4-9ce0-4ff48799e829 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:17.289873 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7288111d-7509-4ec4-9ce0-4ff48799e829 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:17.297859 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7288111d-7509-4ec4-9ce0-4ff48799e829 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.149962 Jul 20 11:36:17.298432 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 56/111] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:17 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:18.163619 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3b2786d2-218d-4b8b-aa68-675b3a00b29e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:18.164239 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3b2786d2-218d-4b8b-aa68-675b3a00b29e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:18.167682 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f6f4f3e-4115-47d9-bb14-66dc6f3d5de7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:18.168295 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f6f4f3e-4115-47d9-bb14-66dc6f3d5de7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:18.170975 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b2786d2-218d-4b8b-aa68-675b3a00b29e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:18.171445 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b2786d2-218d-4b8b-aa68-675b3a00b29e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:18.172188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b2786d2-218d-4b8b-aa68-675b3a00b29e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:18.172622 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b2786d2-218d-4b8b-aa68-675b3a00b29e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:18.174155 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f6f4f3e-4115-47d9-bb14-66dc6f3d5de7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:18.174602 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f6f4f3e-4115-47d9-bb14-66dc6f3d5de7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:18.175703 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f6f4f3e-4115-47d9-bb14-66dc6f3d5de7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:18.176153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f6f4f3e-4115-47d9-bb14-66dc6f3d5de7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:18.367953 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3b2786d2-218d-4b8b-aa68-675b3a00b29e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:18.372551 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f6f4f3e-4115-47d9-bb14-66dc6f3d5de7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:18.375960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3b2786d2-218d-4b8b-aa68-675b3a00b29e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.215776 Jul 20 11:36:18.376232 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 56/112] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:18 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:18.380640 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-179a8c7a-a093-4920-b73b-4dc424ab5098 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:18.381268 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-179a8c7a-a093-4920-b73b-4dc424ab5098 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:18.387840 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-179a8c7a-a093-4920-b73b-4dc424ab5098 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:18.388288 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-179a8c7a-a093-4920-b73b-4dc424ab5098 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:18.389080 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-179a8c7a-a093-4920-b73b-4dc424ab5098 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:18.389513 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-179a8c7a-a093-4920-b73b-4dc424ab5098 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:18.390148 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f6f4f3e-4115-47d9-bb14-66dc6f3d5de7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.226757 Jul 20 11:36:18.390765 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 57/113] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:18 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:18.517240 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-179a8c7a-a093-4920-b73b-4dc424ab5098 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:18.525443 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-179a8c7a-a093-4920-b73b-4dc424ab5098 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.147501 Jul 20 11:36:18.526006 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 57/114] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:18 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:19.393240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5cdba041-e628-4d6c-9d4a-43b0f759382c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:19.393862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5cdba041-e628-4d6c-9d4a-43b0f759382c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:19.400231 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5cdba041-e628-4d6c-9d4a-43b0f759382c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:19.400677 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5cdba041-e628-4d6c-9d4a-43b0f759382c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:19.401451 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5cdba041-e628-4d6c-9d4a-43b0f759382c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:19.401885 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5cdba041-e628-4d6c-9d4a-43b0f759382c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:19.406837 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-85843c9b-75dd-4dbb-9310-6b5a7ba9f990 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:19.407507 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-85843c9b-75dd-4dbb-9310-6b5a7ba9f990 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:19.413535 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85843c9b-75dd-4dbb-9310-6b5a7ba9f990 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:19.416607 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85843c9b-75dd-4dbb-9310-6b5a7ba9f990 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:19.416607 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85843c9b-75dd-4dbb-9310-6b5a7ba9f990 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:19.416607 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-85843c9b-75dd-4dbb-9310-6b5a7ba9f990 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:19.601651 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5cdba041-e628-4d6c-9d4a-43b0f759382c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:19.606851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-85843c9b-75dd-4dbb-9310-6b5a7ba9f990 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:19.610366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5cdba041-e628-4d6c-9d4a-43b0f759382c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.220904 Jul 20 11:36:19.612693 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 58/115] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:19 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:19.616087 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-85843c9b-75dd-4dbb-9310-6b5a7ba9f990 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.212784 Jul 20 11:36:19.616627 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-85555b04-671c-48f9-975b-77f91163759b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:19.617669 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-85555b04-671c-48f9-975b-77f91163759b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:19.623702 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85555b04-671c-48f9-975b-77f91163759b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:19.624239 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85555b04-671c-48f9-975b-77f91163759b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:19.625029 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85555b04-671c-48f9-975b-77f91163759b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:19.625457 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85555b04-671c-48f9-975b-77f91163759b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:19.626949 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 58/116] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:19 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:19.761047 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-85555b04-671c-48f9-975b-77f91163759b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:19.768320 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-85555b04-671c-48f9-975b-77f91163759b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.155955 Jul 20 11:36:19.768900 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 59/117] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:19 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:20.627660 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-37608264-20cd-4ce4-864d-4a25ceb22729 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:20.628270 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-37608264-20cd-4ce4-864d-4a25ceb22729 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:20.634137 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-694928c3-8bc1-4578-8a27-45a6970d2dd7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:20.634588 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37608264-20cd-4ce4-864d-4a25ceb22729 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:20.634771 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-694928c3-8bc1-4578-8a27-45a6970d2dd7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:20.634992 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37608264-20cd-4ce4-864d-4a25ceb22729 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:20.635756 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37608264-20cd-4ce4-864d-4a25ceb22729 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:20.636190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-37608264-20cd-4ce4-864d-4a25ceb22729 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:20.640813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-694928c3-8bc1-4578-8a27-45a6970d2dd7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:20.641268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-694928c3-8bc1-4578-8a27-45a6970d2dd7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:20.642029 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-694928c3-8bc1-4578-8a27-45a6970d2dd7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:20.642461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-694928c3-8bc1-4578-8a27-45a6970d2dd7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:20.647274 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:20.664962 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:20.826129 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-37608264-20cd-4ce4-864d-4a25ceb22729 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:20.834444 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-37608264-20cd-4ce4-864d-4a25ceb22729 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.210591 Jul 20 11:36:20.835017 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 59/118] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:20 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:20.840309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0659e9a6-32fd-4bb8-9731-cf6ef29a24af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:20.848246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0659e9a6-32fd-4bb8-9731-cf6ef29a24af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:20.848246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0659e9a6-32fd-4bb8-9731-cf6ef29a24af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:20.848246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0659e9a6-32fd-4bb8-9731-cf6ef29a24af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:20.848670 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-694928c3-8bc1-4578-8a27-45a6970d2dd7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:20.848777 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0659e9a6-32fd-4bb8-9731-cf6ef29a24af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:20.848777 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0659e9a6-32fd-4bb8-9731-cf6ef29a24af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:20.855099 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-694928c3-8bc1-4578-8a27-45a6970d2dd7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.224989 Jul 20 11:36:20.855662 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 60/119] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:20 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:20.980088 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0659e9a6-32fd-4bb8-9731-cf6ef29a24af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:20.987433 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0659e9a6-32fd-4bb8-9731-cf6ef29a24af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.151479 Jul 20 11:36:20.988001 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 60/120] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:20 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:21.851380 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6dd91cd4-54dd-4616-b76a-b40d2204535d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:21.851979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6dd91cd4-54dd-4616-b76a-b40d2204535d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:21.859479 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dd91cd4-54dd-4616-b76a-b40d2204535d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:21.859919 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dd91cd4-54dd-4616-b76a-b40d2204535d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:21.860669 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dd91cd4-54dd-4616-b76a-b40d2204535d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:21.861130 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6dd91cd4-54dd-4616-b76a-b40d2204535d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:21.871336 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0c4cb1d6-7b51-4696-a53f-638bf65eec66 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:21.871936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0c4cb1d6-7b51-4696-a53f-638bf65eec66 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:21.878040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c4cb1d6-7b51-4696-a53f-638bf65eec66 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:21.878477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c4cb1d6-7b51-4696-a53f-638bf65eec66 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:21.879235 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c4cb1d6-7b51-4696-a53f-638bf65eec66 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:21.879661 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c4cb1d6-7b51-4696-a53f-638bf65eec66 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:22.047923 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6dd91cd4-54dd-4616-b76a-b40d2204535d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:22.055644 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6dd91cd4-54dd-4616-b76a-b40d2204535d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.208007 Jul 20 11:36:22.056669 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 61/121] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:21 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:22.069345 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-817a1df6-325c-499c-b1d3-9468c480a0b8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:22.070155 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-817a1df6-325c-499c-b1d3-9468c480a0b8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:22.072470 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0c4cb1d6-7b51-4696-a53f-638bf65eec66 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:22.080467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0c4cb1d6-7b51-4696-a53f-638bf65eec66 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.212682 Jul 20 11:36:22.081085 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 61/122] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:21 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:22.087835 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-817a1df6-325c-499c-b1d3-9468c480a0b8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:22.088285 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-817a1df6-325c-499c-b1d3-9468c480a0b8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:22.097966 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-817a1df6-325c-499c-b1d3-9468c480a0b8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:22.097966 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-817a1df6-325c-499c-b1d3-9468c480a0b8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:22.225546 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-817a1df6-325c-499c-b1d3-9468c480a0b8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:22.245087 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-817a1df6-325c-499c-b1d3-9468c480a0b8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.172955 Jul 20 11:36:22.245087 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 62/123] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:22 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:23.073498 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e9ab1deb-6bd3-4a35-b680-53f2b9ee2f34 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:23.074082 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e9ab1deb-6bd3-4a35-b680-53f2b9ee2f34 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:23.080231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9ab1deb-6bd3-4a35-b680-53f2b9ee2f34 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:23.080679 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9ab1deb-6bd3-4a35-b680-53f2b9ee2f34 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:23.081476 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9ab1deb-6bd3-4a35-b680-53f2b9ee2f34 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:23.081912 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9ab1deb-6bd3-4a35-b680-53f2b9ee2f34 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:23.098556 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1d352b08-74c3-4445-9568-1c1db9b9e05f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:23.101580 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1d352b08-74c3-4445-9568-1c1db9b9e05f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:23.106649 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d352b08-74c3-4445-9568-1c1db9b9e05f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:23.113374 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d352b08-74c3-4445-9568-1c1db9b9e05f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:23.114157 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d352b08-74c3-4445-9568-1c1db9b9e05f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:23.114593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d352b08-74c3-4445-9568-1c1db9b9e05f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:23.289272 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e9ab1deb-6bd3-4a35-b680-53f2b9ee2f34 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:23.293262 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1d352b08-74c3-4445-9568-1c1db9b9e05f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:23.297574 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e9ab1deb-6bd3-4a35-b680-53f2b9ee2f34 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.228476 Jul 20 11:36:23.298267 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 62/124] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:23 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:23.300747 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1d352b08-74c3-4445-9568-1c1db9b9e05f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.206501 Jul 20 11:36:23.301477 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 63/125] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:23 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:23.303321 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e9be69bf-b55e-4ddb-9ae7-9a58115500d8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:23.304034 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e9be69bf-b55e-4ddb-9ae7-9a58115500d8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:23.311515 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9be69bf-b55e-4ddb-9ae7-9a58115500d8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:23.311962 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9be69bf-b55e-4ddb-9ae7-9a58115500d8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:23.312730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9be69bf-b55e-4ddb-9ae7-9a58115500d8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:23.313192 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9be69bf-b55e-4ddb-9ae7-9a58115500d8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:23.473058 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e9be69bf-b55e-4ddb-9ae7-9a58115500d8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:23.481089 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e9be69bf-b55e-4ddb-9ae7-9a58115500d8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.181541 Jul 20 11:36:23.481659 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 63/126] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:23 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:24.315627 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3ba68329-4831-45de-a76c-52f0860860b3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:24.316235 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3ba68329-4831-45de-a76c-52f0860860b3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:24.320015 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dbbd1762-881c-4885-bf67-41eeab61490b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:24.320015 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dbbd1762-881c-4885-bf67-41eeab61490b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:24.324224 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbbd1762-881c-4885-bf67-41eeab61490b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:24.324668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbbd1762-881c-4885-bf67-41eeab61490b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:24.325583 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbbd1762-881c-4885-bf67-41eeab61490b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:24.325919 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbbd1762-881c-4885-bf67-41eeab61490b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:24.330079 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ba68329-4831-45de-a76c-52f0860860b3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:24.330535 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ba68329-4831-45de-a76c-52f0860860b3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:24.331557 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ba68329-4831-45de-a76c-52f0860860b3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:24.332023 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ba68329-4831-45de-a76c-52f0860860b3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:24.580058 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dbbd1762-881c-4885-bf67-41eeab61490b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:24.587763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3ba68329-4831-45de-a76c-52f0860860b3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:24.588010 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dbbd1762-881c-4885-bf67-41eeab61490b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.274867 Jul 20 11:36:24.589630 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 64/127] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:24 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:24.593479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-06adc5fe-6864-4ae4-893e-8ddbbf288e31 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:24.594071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-06adc5fe-6864-4ae4-893e-8ddbbf288e31 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:24.595784 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3ba68329-4831-45de-a76c-52f0860860b3 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.285059 Jul 20 11:36:24.596717 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 64/128] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:24 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:24.605100 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06adc5fe-6864-4ae4-893e-8ddbbf288e31 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:24.605549 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06adc5fe-6864-4ae4-893e-8ddbbf288e31 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:24.606313 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06adc5fe-6864-4ae4-893e-8ddbbf288e31 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:24.606750 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06adc5fe-6864-4ae4-893e-8ddbbf288e31 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:24.761735 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-06adc5fe-6864-4ae4-893e-8ddbbf288e31 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:24.769827 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-06adc5fe-6864-4ae4-893e-8ddbbf288e31 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.180195 Jul 20 11:36:24.771733 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 65/129] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:24 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:25.605953 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-27e9db29-4c8d-40f3-b263-9a991f4cc2ea tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:25.606560 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-27e9db29-4c8d-40f3-b263-9a991f4cc2ea tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:25.612631 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c46e01e2-7cfa-4c61-95b4-96bc94253598 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:25.613092 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27e9db29-4c8d-40f3-b263-9a991f4cc2ea tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:25.613286 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c46e01e2-7cfa-4c61-95b4-96bc94253598 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:25.613395 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27e9db29-4c8d-40f3-b263-9a991f4cc2ea tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:25.614088 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27e9db29-4c8d-40f3-b263-9a991f4cc2ea tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:25.614521 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27e9db29-4c8d-40f3-b263-9a991f4cc2ea tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:25.619166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c46e01e2-7cfa-4c61-95b4-96bc94253598 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:25.619614 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c46e01e2-7cfa-4c61-95b4-96bc94253598 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:25.620376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c46e01e2-7cfa-4c61-95b4-96bc94253598 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:25.620827 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c46e01e2-7cfa-4c61-95b4-96bc94253598 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:25.817689 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c46e01e2-7cfa-4c61-95b4-96bc94253598 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:25.821868 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-27e9db29-4c8d-40f3-b263-9a991f4cc2ea tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:25.826302 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c46e01e2-7cfa-4c61-95b4-96bc94253598 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.217417 Jul 20 11:36:25.826872 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 66/130] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:25 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:25.829696 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-27e9db29-4c8d-40f3-b263-9a991f4cc2ea tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.228080 Jul 20 11:36:25.830313 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 65/131] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:25 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:25.831792 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-166ff5cf-904c-4215-b8b5-d1c8c4a2b17d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:25.832393 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-166ff5cf-904c-4215-b8b5-d1c8c4a2b17d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:25.838283 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-166ff5cf-904c-4215-b8b5-d1c8c4a2b17d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:25.838731 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-166ff5cf-904c-4215-b8b5-d1c8c4a2b17d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:25.839493 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-166ff5cf-904c-4215-b8b5-d1c8c4a2b17d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:25.839927 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-166ff5cf-904c-4215-b8b5-d1c8c4a2b17d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:25.980053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-166ff5cf-904c-4215-b8b5-d1c8c4a2b17d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:25.987624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-166ff5cf-904c-4215-b8b5-d1c8c4a2b17d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.159662 Jul 20 11:36:25.988243 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 67/132] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:25 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:26.843596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6c129e1-8895-4906-a173-b6284a23234c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:26.844415 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6c129e1-8895-4906-a173-b6284a23234c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:26.846470 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=71 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:26.846669 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-94a10a97-c0e1-4aa1-9d69-971d4dd2c85f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:26.847757 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-94a10a97-c0e1-4aa1-9d69-971d4dd2c85f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:26.851535 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6c129e1-8895-4906-a173-b6284a23234c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:26.852176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6c129e1-8895-4906-a173-b6284a23234c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:26.853393 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6c129e1-8895-4906-a173-b6284a23234c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:26.854053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6c129e1-8895-4906-a173-b6284a23234c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:26.865599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94a10a97-c0e1-4aa1-9d69-971d4dd2c85f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:26.865599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94a10a97-c0e1-4aa1-9d69-971d4dd2c85f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:26.866523 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94a10a97-c0e1-4aa1-9d69-971d4dd2c85f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:26.866976 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94a10a97-c0e1-4aa1-9d69-971d4dd2c85f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:27.068305 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-94a10a97-c0e1-4aa1-9d69-971d4dd2c85f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:27.072433 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6c129e1-8895-4906-a173-b6284a23234c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:27.075690 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-94a10a97-c0e1-4aa1-9d69-971d4dd2c85f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.232802 Jul 20 11:36:27.076262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 68/133] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:26 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:27.080161 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6c129e1-8895-4906-a173-b6284a23234c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.240417 Jul 20 11:36:27.080644 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-920eae45-a141-4226-aa84-1cc3f5198562 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:27.081019 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 66/134] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:26 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:27.085890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-920eae45-a141-4226-aa84-1cc3f5198562 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:27.091942 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-920eae45-a141-4226-aa84-1cc3f5198562 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:27.092414 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-920eae45-a141-4226-aa84-1cc3f5198562 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:27.093217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-920eae45-a141-4226-aa84-1cc3f5198562 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:27.093702 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-920eae45-a141-4226-aa84-1cc3f5198562 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:27.227418 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-920eae45-a141-4226-aa84-1cc3f5198562 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:27.234806 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-920eae45-a141-4226-aa84-1cc3f5198562 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.157621 Jul 20 11:36:27.235368 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 69/135] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:27 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:28.094127 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-85422326-e08a-4abd-80fc-67172287cbb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:28.094777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-85422326-e08a-4abd-80fc-67172287cbb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:28.097750 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75aadb1b-4e35-4446-b8f9-e92074e5b388 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:28.098665 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75aadb1b-4e35-4446-b8f9-e92074e5b388 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:28.100906 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85422326-e08a-4abd-80fc-67172287cbb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:28.101350 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85422326-e08a-4abd-80fc-67172287cbb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:28.102161 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85422326-e08a-4abd-80fc-67172287cbb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:28.102600 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85422326-e08a-4abd-80fc-67172287cbb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:28.107306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75aadb1b-4e35-4446-b8f9-e92074e5b388 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:28.107820 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75aadb1b-4e35-4446-b8f9-e92074e5b388 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:28.109098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75aadb1b-4e35-4446-b8f9-e92074e5b388 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:28.109790 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-75aadb1b-4e35-4446-b8f9-e92074e5b388 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:28.302817 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-85422326-e08a-4abd-80fc-67172287cbb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:28.310140 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-75aadb1b-4e35-4446-b8f9-e92074e5b388 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:28.311471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-85422326-e08a-4abd-80fc-67172287cbb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.221589 Jul 20 11:36:28.312593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 67/136] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:28 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:28.317351 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-20328aee-7bce-49db-973d-58d658d90373 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:28.317954 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-20328aee-7bce-49db-973d-58d658d90373 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:28.318365 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75aadb1b-4e35-4446-b8f9-e92074e5b388 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.225128 Jul 20 11:36:28.318931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 70/137] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:28 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:28.324461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20328aee-7bce-49db-973d-58d658d90373 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:28.325178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20328aee-7bce-49db-973d-58d658d90373 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:28.326215 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20328aee-7bce-49db-973d-58d658d90373 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:28.326729 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-20328aee-7bce-49db-973d-58d658d90373 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:28.464091 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-20328aee-7bce-49db-973d-58d658d90373 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:28.471459 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-20328aee-7bce-49db-973d-58d658d90373 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.157681 Jul 20 11:36:28.476336 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 68/138] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:28 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:29.369305 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6a00a4a6-fcfa-4127-88fd-e7526be4050b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:29.370164 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6a00a4a6-fcfa-4127-88fd-e7526be4050b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:29.376571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a00a4a6-fcfa-4127-88fd-e7526be4050b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:29.377038 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a00a4a6-fcfa-4127-88fd-e7526be4050b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:29.377775 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3aebae00-ac8c-4927-b4d2-6c789e452ba2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:29.378201 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a00a4a6-fcfa-4127-88fd-e7526be4050b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:29.378305 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6a00a4a6-fcfa-4127-88fd-e7526be4050b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:29.378392 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3aebae00-ac8c-4927-b4d2-6c789e452ba2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:29.384492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3aebae00-ac8c-4927-b4d2-6c789e452ba2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:29.384979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3aebae00-ac8c-4927-b4d2-6c789e452ba2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:29.385740 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3aebae00-ac8c-4927-b4d2-6c789e452ba2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:29.386170 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3aebae00-ac8c-4927-b4d2-6c789e452ba2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:29.571734 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6a00a4a6-fcfa-4127-88fd-e7526be4050b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:29.580030 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6a00a4a6-fcfa-4127-88fd-e7526be4050b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.214842 Jul 20 11:36:29.583484 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 71/139] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:29 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:29.588532 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-677f6ac7-92c8-4b4a-9f1b-aca74185baa9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:29.589154 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-677f6ac7-92c8-4b4a-9f1b-aca74185baa9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:29.592588 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=84 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:29.597231 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3aebae00-ac8c-4927-b4d2-6c789e452ba2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:29.602949 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-677f6ac7-92c8-4b4a-9f1b-aca74185baa9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:29.612879 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-677f6ac7-92c8-4b4a-9f1b-aca74185baa9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:29.612879 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-677f6ac7-92c8-4b4a-9f1b-aca74185baa9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:29.612879 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-677f6ac7-92c8-4b4a-9f1b-aca74185baa9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:29.613467 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3aebae00-ac8c-4927-b4d2-6c789e452ba2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.231260 Jul 20 11:36:29.613467 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 69/140] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:29 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:29.740204 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-677f6ac7-92c8-4b4a-9f1b-aca74185baa9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:29.748630 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-677f6ac7-92c8-4b4a-9f1b-aca74185baa9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.164263 Jul 20 11:36:29.749454 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 72/141] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:29 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:30.598025 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d8388f6d-4cf7-4e77-92bc-bcf40eb37374 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:30.598637 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d8388f6d-4cf7-4e77-92bc-bcf40eb37374 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:30.604902 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8388f6d-4cf7-4e77-92bc-bcf40eb37374 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:30.605352 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8388f6d-4cf7-4e77-92bc-bcf40eb37374 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:30.606121 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8388f6d-4cf7-4e77-92bc-bcf40eb37374 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:30.606572 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8388f6d-4cf7-4e77-92bc-bcf40eb37374 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:30.628412 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1cec4eb4-6f8d-4b7f-8492-f0e7f7a938ec tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:30.629090 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1cec4eb4-6f8d-4b7f-8492-f0e7f7a938ec tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:30.636308 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1cec4eb4-6f8d-4b7f-8492-f0e7f7a938ec tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:30.636949 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1cec4eb4-6f8d-4b7f-8492-f0e7f7a938ec tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:30.637866 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1cec4eb4-6f8d-4b7f-8492-f0e7f7a938ec tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:30.638357 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1cec4eb4-6f8d-4b7f-8492-f0e7f7a938ec tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:30.809995 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d8388f6d-4cf7-4e77-92bc-bcf40eb37374 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:30.814360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1cec4eb4-6f8d-4b7f-8492-f0e7f7a938ec tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:30.818421 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d8388f6d-4cf7-4e77-92bc-bcf40eb37374 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.224754 Jul 20 11:36:30.819225 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 70/142] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:30 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:30.825212 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f1f1137a-1d76-495c-8b8b-8ee1f7ac5be0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:30.825890 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f1f1137a-1d76-495c-8b8b-8ee1f7ac5be0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:30.831256 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1cec4eb4-6f8d-4b7f-8492-f0e7f7a938ec tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.206602 Jul 20 11:36:30.831993 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 73/143] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:30 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:30.832230 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1f1137a-1d76-495c-8b8b-8ee1f7ac5be0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:30.833003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1f1137a-1d76-495c-8b8b-8ee1f7ac5be0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:30.834073 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1f1137a-1d76-495c-8b8b-8ee1f7ac5be0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:30.834574 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1f1137a-1d76-495c-8b8b-8ee1f7ac5be0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:30.973943 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f1f1137a-1d76-495c-8b8b-8ee1f7ac5be0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:30.981621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f1f1137a-1d76-495c-8b8b-8ee1f7ac5be0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.160930 Jul 20 11:36:30.982193 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 71/144] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:30 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:31.835588 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e7e0011-b1e3-405b-98dc-c8bda3d14d81 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:31.836195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2e7e0011-b1e3-405b-98dc-c8bda3d14d81 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:31.843858 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e7e0011-b1e3-405b-98dc-c8bda3d14d81 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:31.844275 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e7e0011-b1e3-405b-98dc-c8bda3d14d81 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:31.845075 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e7e0011-b1e3-405b-98dc-c8bda3d14d81 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:31.845503 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e7e0011-b1e3-405b-98dc-c8bda3d14d81 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:31.847917 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-baf2a59f-a9a0-4529-83c6-01d6d4b4771e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:31.848731 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-baf2a59f-a9a0-4529-83c6-01d6d4b4771e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:31.855360 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-baf2a59f-a9a0-4529-83c6-01d6d4b4771e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:31.856043 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-baf2a59f-a9a0-4529-83c6-01d6d4b4771e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:31.857098 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-baf2a59f-a9a0-4529-83c6-01d6d4b4771e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:31.857597 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-baf2a59f-a9a0-4529-83c6-01d6d4b4771e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:32.060814 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2e7e0011-b1e3-405b-98dc-c8bda3d14d81 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:32.063859 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-baf2a59f-a9a0-4529-83c6-01d6d4b4771e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:32.069737 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2e7e0011-b1e3-405b-98dc-c8bda3d14d81 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.237615 Jul 20 11:36:32.070318 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 74/145] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:31 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:32.078163 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-10b94146-7c8b-4a49-aef2-369a6a6ec147 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:32.078163 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-10b94146-7c8b-4a49-aef2-369a6a6ec147 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:32.079461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-baf2a59f-a9a0-4529-83c6-01d6d4b4771e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.235713 Jul 20 11:36:32.080695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 72/146] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:31 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:32.084014 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10b94146-7c8b-4a49-aef2-369a6a6ec147 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:32.084466 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10b94146-7c8b-4a49-aef2-369a6a6ec147 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:32.085271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10b94146-7c8b-4a49-aef2-369a6a6ec147 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:32.085707 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10b94146-7c8b-4a49-aef2-369a6a6ec147 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:32.213587 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-10b94146-7c8b-4a49-aef2-369a6a6ec147 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:32.220830 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-10b94146-7c8b-4a49-aef2-369a6a6ec147 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.149335 Jul 20 11:36:32.221475 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 75/147] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:32 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:33.097246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f8db6ef1-91dc-4a30-8862-a712654297b7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:33.098032 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f8db6ef1-91dc-4a30-8862-a712654297b7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:33.102514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-802f7a99-924a-4769-aec6-b74c1622488b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:33.103119 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-802f7a99-924a-4769-aec6-b74c1622488b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:33.104179 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8db6ef1-91dc-4a30-8862-a712654297b7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:33.104648 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8db6ef1-91dc-4a30-8862-a712654297b7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:33.105421 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8db6ef1-91dc-4a30-8862-a712654297b7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:33.105918 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f8db6ef1-91dc-4a30-8862-a712654297b7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:33.123100 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-802f7a99-924a-4769-aec6-b74c1622488b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:33.123100 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-802f7a99-924a-4769-aec6-b74c1622488b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:33.123100 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-802f7a99-924a-4769-aec6-b74c1622488b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:33.123100 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-802f7a99-924a-4769-aec6-b74c1622488b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:33.123457 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:33.296323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f8db6ef1-91dc-4a30-8862-a712654297b7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:33.303238 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-802f7a99-924a-4769-aec6-b74c1622488b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:33.303593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f8db6ef1-91dc-4a30-8862-a712654297b7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.210136 Jul 20 11:36:33.304365 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 73/148] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:33 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:33.309622 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8d59fa12-52b6-4ff6-aeba-7c90f141ee81 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:33.310410 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8d59fa12-52b6-4ff6-aeba-7c90f141ee81 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:33.311563 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-802f7a99-924a-4769-aec6-b74c1622488b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.213447 Jul 20 11:36:33.312124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 76/149] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:33 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:33.316134 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d59fa12-52b6-4ff6-aeba-7c90f141ee81 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:33.316599 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d59fa12-52b6-4ff6-aeba-7c90f141ee81 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:33.317384 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d59fa12-52b6-4ff6-aeba-7c90f141ee81 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:33.317817 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d59fa12-52b6-4ff6-aeba-7c90f141ee81 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:33.440743 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8d59fa12-52b6-4ff6-aeba-7c90f141ee81 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:33.448419 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8d59fa12-52b6-4ff6-aeba-7c90f141ee81 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.143252 Jul 20 11:36:33.449020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 74/150] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:33 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:34.320286 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2aea465-5a60-46f9-9264-e0b73c334753 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:34.321405 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2aea465-5a60-46f9-9264-e0b73c334753 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:34.327464 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2aea465-5a60-46f9-9264-e0b73c334753 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:34.327710 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f1a622c8-4e63-4e43-a791-0277a3c83231 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:34.328115 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2aea465-5a60-46f9-9264-e0b73c334753 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:34.328328 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f1a622c8-4e63-4e43-a791-0277a3c83231 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:34.328648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2aea465-5a60-46f9-9264-e0b73c334753 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:34.329099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2aea465-5a60-46f9-9264-e0b73c334753 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:34.334219 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1a622c8-4e63-4e43-a791-0277a3c83231 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:34.334665 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1a622c8-4e63-4e43-a791-0277a3c83231 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:34.335426 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1a622c8-4e63-4e43-a791-0277a3c83231 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:34.335857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1a622c8-4e63-4e43-a791-0277a3c83231 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:34.525021 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2aea465-5a60-46f9-9264-e0b73c334753 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:34.527928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f1a622c8-4e63-4e43-a791-0277a3c83231 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:34.532583 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2aea465-5a60-46f9-9264-e0b73c334753 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.216217 Jul 20 11:36:34.533202 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 77/151] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:34 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:34.535148 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f1a622c8-4e63-4e43-a791-0277a3c83231 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.211241 Jul 20 11:36:34.544271 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 75/152] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:34 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:34.544560 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f23d03f9-d0a0-4ef0-9193-df5765af613c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:34.544560 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f23d03f9-d0a0-4ef0-9193-df5765af613c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:34.544560 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f23d03f9-d0a0-4ef0-9193-df5765af613c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:34.544560 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f23d03f9-d0a0-4ef0-9193-df5765af613c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:34.545369 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f23d03f9-d0a0-4ef0-9193-df5765af613c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:34.545805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f23d03f9-d0a0-4ef0-9193-df5765af613c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:34.673162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f23d03f9-d0a0-4ef0-9193-df5765af613c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:34.681070 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f23d03f9-d0a0-4ef0-9193-df5765af613c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.146189 Jul 20 11:36:34.681634 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 78/153] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:34 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:35.551406 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-621eb813-e15f-4733-b9de-c94cd2a338f8 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:35.552059 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4131086e-8c22-4365-ae54-aec1c44423f1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:35.552059 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4131086e-8c22-4365-ae54-aec1c44423f1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:35.552550 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-621eb813-e15f-4733-b9de-c94cd2a338f8 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:35.558068 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4131086e-8c22-4365-ae54-aec1c44423f1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:35.558247 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-621eb813-e15f-4733-b9de-c94cd2a338f8 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:35.558509 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4131086e-8c22-4365-ae54-aec1c44423f1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:35.558632 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-621eb813-e15f-4733-b9de-c94cd2a338f8 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:35.559262 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4131086e-8c22-4365-ae54-aec1c44423f1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:35.559372 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-621eb813-e15f-4733-b9de-c94cd2a338f8 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:35.559727 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4131086e-8c22-4365-ae54-aec1c44423f1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:35.559857 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-621eb813-e15f-4733-b9de-c94cd2a338f8 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:35.755195 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4131086e-8c22-4365-ae54-aec1c44423f1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:35.759050 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-621eb813-e15f-4733-b9de-c94cd2a338f8 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:35.762544 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:35.766393 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-621eb813-e15f-4733-b9de-c94cd2a338f8 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.218861 Jul 20 11:36:35.766965 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 79/154] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:35 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:35.767104 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4131086e-8c22-4365-ae54-aec1c44423f1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.219470 Jul 20 11:36:35.767703 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 76/155] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:35 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:35.771327 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6e2c510d-7fa5-4c69-b386-be9424d5ceb4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:35.771930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6e2c510d-7fa5-4c69-b386-be9424d5ceb4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:35.778144 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e2c510d-7fa5-4c69-b386-be9424d5ceb4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:35.778586 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e2c510d-7fa5-4c69-b386-be9424d5ceb4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:35.779344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e2c510d-7fa5-4c69-b386-be9424d5ceb4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:35.779778 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e2c510d-7fa5-4c69-b386-be9424d5ceb4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:35.908714 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6e2c510d-7fa5-4c69-b386-be9424d5ceb4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:35.916219 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6e2c510d-7fa5-4c69-b386-be9424d5ceb4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.148318 Jul 20 11:36:35.916790 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 80/156] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:35 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:36.791914 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9937deb4-3681-4b69-987b-8214386ef0a7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:36.793108 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-244e6d33-1d40-42b9-b623-98f89e2e1269 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:36.793527 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9937deb4-3681-4b69-987b-8214386ef0a7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:36.793628 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-244e6d33-1d40-42b9-b623-98f89e2e1269 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:36.798668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-244e6d33-1d40-42b9-b623-98f89e2e1269 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:36.798965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9937deb4-3681-4b69-987b-8214386ef0a7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:36.799199 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-244e6d33-1d40-42b9-b623-98f89e2e1269 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:36.799458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9937deb4-3681-4b69-987b-8214386ef0a7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:36.799855 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-244e6d33-1d40-42b9-b623-98f89e2e1269 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:36.800219 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9937deb4-3681-4b69-987b-8214386ef0a7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:36.800311 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-244e6d33-1d40-42b9-b623-98f89e2e1269 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:36.800654 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9937deb4-3681-4b69-987b-8214386ef0a7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:36.995617 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-244e6d33-1d40-42b9-b623-98f89e2e1269 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:37.000075 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9937deb4-3681-4b69-987b-8214386ef0a7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:37.003779 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-244e6d33-1d40-42b9-b623-98f89e2e1269 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.216075 Jul 20 11:36:37.004485 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 81/157] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:36 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:37.009848 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e0431a49-f232-4da3-b63c-b812989c5189 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:37.010771 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e0431a49-f232-4da3-b63c-b812989c5189 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:37.011983 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9937deb4-3681-4b69-987b-8214386ef0a7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.224348 Jul 20 11:36:37.012617 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 77/158] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:36 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:37.017362 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0431a49-f232-4da3-b63c-b812989c5189 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:37.018056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0431a49-f232-4da3-b63c-b812989c5189 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:37.018953 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0431a49-f232-4da3-b63c-b812989c5189 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:37.019372 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e0431a49-f232-4da3-b63c-b812989c5189 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:37.156232 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e0431a49-f232-4da3-b63c-b812989c5189 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:37.164152 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e0431a49-f232-4da3-b63c-b812989c5189 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.158499 Jul 20 11:36:37.165268 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 82/159] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:37 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:38.021437 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-740f5ee0-b827-42f0-b73d-5b0ee9fddc0d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:38.024228 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-740f5ee0-b827-42f0-b73d-5b0ee9fddc0d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:38.029158 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f32a7ea4-9396-4559-85fa-60ce594e6a38 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:38.029801 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f32a7ea4-9396-4559-85fa-60ce594e6a38 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:38.030475 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-740f5ee0-b827-42f0-b73d-5b0ee9fddc0d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:38.030937 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-740f5ee0-b827-42f0-b73d-5b0ee9fddc0d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:38.031711 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-740f5ee0-b827-42f0-b73d-5b0ee9fddc0d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:38.032149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-740f5ee0-b827-42f0-b73d-5b0ee9fddc0d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:38.036065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32a7ea4-9396-4559-85fa-60ce594e6a38 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:38.036508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32a7ea4-9396-4559-85fa-60ce594e6a38 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:38.037461 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32a7ea4-9396-4559-85fa-60ce594e6a38 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:38.037919 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32a7ea4-9396-4559-85fa-60ce594e6a38 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:38.410428 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-740f5ee0-b827-42f0-b73d-5b0ee9fddc0d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:38.416889 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f32a7ea4-9396-4559-85fa-60ce594e6a38 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:38.419258 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-740f5ee0-b827-42f0-b73d-5b0ee9fddc0d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.401560 Jul 20 11:36:38.419909 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 78/160] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:38 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:38.424522 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-64a21645-165c-4e01-8d40-b0c7721ed49f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:38.425636 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-64a21645-165c-4e01-8d40-b0c7721ed49f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:38.425761 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f32a7ea4-9396-4559-85fa-60ce594e6a38 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.400224 Jul 20 11:36:38.431351 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64a21645-165c-4e01-8d40-b0c7721ed49f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:38.431852 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64a21645-165c-4e01-8d40-b0c7721ed49f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:38.434503 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64a21645-165c-4e01-8d40-b0c7721ed49f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:38.434503 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64a21645-165c-4e01-8d40-b0c7721ed49f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:38.435094 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 83/161] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:38 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:38.622594 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-64a21645-165c-4e01-8d40-b0c7721ed49f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:38.629940 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-64a21645-165c-4e01-8d40-b0c7721ed49f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.209100 Jul 20 11:36:38.630497 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 79/162] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:38 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:39.436035 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b50c3492-7ccb-4fb9-9629-2ce46bd7a727 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:39.436654 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b50c3492-7ccb-4fb9-9629-2ce46bd7a727 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:39.442316 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-28492394-a0d3-43dd-8129-58a16c4d085f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:39.442740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b50c3492-7ccb-4fb9-9629-2ce46bd7a727 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:39.442915 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-28492394-a0d3-43dd-8129-58a16c4d085f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:39.443128 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b50c3492-7ccb-4fb9-9629-2ce46bd7a727 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:39.443893 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b50c3492-7ccb-4fb9-9629-2ce46bd7a727 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:39.444318 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b50c3492-7ccb-4fb9-9629-2ce46bd7a727 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:39.448815 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28492394-a0d3-43dd-8129-58a16c4d085f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:39.449256 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28492394-a0d3-43dd-8129-58a16c4d085f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:39.450009 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28492394-a0d3-43dd-8129-58a16c4d085f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:39.450435 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28492394-a0d3-43dd-8129-58a16c4d085f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:39.650906 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b50c3492-7ccb-4fb9-9629-2ce46bd7a727 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:39.657765 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-28492394-a0d3-43dd-8129-58a16c4d085f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:39.662659 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b50c3492-7ccb-4fb9-9629-2ce46bd7a727 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.230384 Jul 20 11:36:39.663333 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 84/163] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:39 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:39.672099 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-28492394-a0d3-43dd-8129-58a16c4d085f tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.233443 Jul 20 11:36:39.672843 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 80/164] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:39 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:39.674445 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9413f509-9df0-4fc2-ba0b-01f66b57d425 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:39.675166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9413f509-9df0-4fc2-ba0b-01f66b57d425 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:39.681692 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9413f509-9df0-4fc2-ba0b-01f66b57d425 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:39.682137 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9413f509-9df0-4fc2-ba0b-01f66b57d425 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:39.683073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9413f509-9df0-4fc2-ba0b-01f66b57d425 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:39.683755 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9413f509-9df0-4fc2-ba0b-01f66b57d425 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:39.839708 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9413f509-9df0-4fc2-ba0b-01f66b57d425 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:39.846385 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9413f509-9df0-4fc2-ba0b-01f66b57d425 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.181959 Jul 20 11:36:39.847133 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 85/165] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:39 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:40.010105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-7933e294-4eb3-494c-8628-cfbeda4746de req-ef4d82c1-a2fa-4eaf-95f0-0c95e207654a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c74b02-2e59-452e-9d39-949b9325a4e4", "name": "network-vif-plugged", "status": "completed", "tag": "fa80c6ca-bceb-4f8e-a20a-e0d485f3c1d1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:36:40.018080 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-7933e294-4eb3-494c-8628-cfbeda4746de req-ef4d82c1-a2fa-4eaf-95f0-0c95e207654a service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:40.018521 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-7933e294-4eb3-494c-8628-cfbeda4746de req-ef4d82c1-a2fa-4eaf-95f0-0c95e207654a service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:40.029775 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-7933e294-4eb3-494c-8628-cfbeda4746de req-ef4d82c1-a2fa-4eaf-95f0-0c95e207654a service nova] Creating event network-vif-plugged:fa80c6ca-bceb-4f8e-a20a-e0d485f3c1d1 for instance 67c74b02-2e59-452e-9d39-949b9325a4e4 on hv-cinder-82282 Jul 20 11:36:40.034862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-7933e294-4eb3-494c-8628-cfbeda4746de req-ef4d82c1-a2fa-4eaf-95f0-0c95e207654a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093809 Jul 20 11:36:40.035431 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 81/166] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:36:40.680953 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c601ce04-8990-467f-ad2c-9a8cb3739859 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:40.681567 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c601ce04-8990-467f-ad2c-9a8cb3739859 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:40.688187 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c601ce04-8990-467f-ad2c-9a8cb3739859 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:40.693520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c601ce04-8990-467f-ad2c-9a8cb3739859 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:40.693520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c601ce04-8990-467f-ad2c-9a8cb3739859 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:40.693520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c601ce04-8990-467f-ad2c-9a8cb3739859 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:40.693783 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aa113727-5725-45d8-b2bd-dfca5579a6a9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:40.693783 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aa113727-5725-45d8-b2bd-dfca5579a6a9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:40.699585 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa113727-5725-45d8-b2bd-dfca5579a6a9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:40.700217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa113727-5725-45d8-b2bd-dfca5579a6a9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:40.701012 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa113727-5725-45d8-b2bd-dfca5579a6a9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:40.701446 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aa113727-5725-45d8-b2bd-dfca5579a6a9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:40.933856 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c601ce04-8990-467f-ad2c-9a8cb3739859 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:40.938387 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aa113727-5725-45d8-b2bd-dfca5579a6a9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:40.941864 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c601ce04-8990-467f-ad2c-9a8cb3739859 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.266224 Jul 20 11:36:40.942629 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 86/167] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:40 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:40.946507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aa113727-5725-45d8-b2bd-dfca5579a6a9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.260185 Jul 20 11:36:40.947151 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 82/168] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:40 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:40.956091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eac95fc1-1239-426d-91eb-b0bd5973fb5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:40.956091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eac95fc1-1239-426d-91eb-b0bd5973fb5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:40.956091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eac95fc1-1239-426d-91eb-b0bd5973fb5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:40.956091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eac95fc1-1239-426d-91eb-b0bd5973fb5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:40.956466 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eac95fc1-1239-426d-91eb-b0bd5973fb5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:40.956466 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eac95fc1-1239-426d-91eb-b0bd5973fb5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:41.087321 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eac95fc1-1239-426d-91eb-b0bd5973fb5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:41.094967 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eac95fc1-1239-426d-91eb-b0bd5973fb5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.151190 Jul 20 11:36:41.099190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 87/169] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:40 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:41.959392 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-64769169-c405-4269-a659-ea797a9eff4a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:41.963883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-64769169-c405-4269-a659-ea797a9eff4a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:41.964009 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6695022c-e219-4074-aafa-5a6a856eee31 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:41.964434 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6695022c-e219-4074-aafa-5a6a856eee31 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:41.967228 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64769169-c405-4269-a659-ea797a9eff4a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:41.967654 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64769169-c405-4269-a659-ea797a9eff4a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:41.968419 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64769169-c405-4269-a659-ea797a9eff4a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:41.968889 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64769169-c405-4269-a659-ea797a9eff4a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:41.970083 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6695022c-e219-4074-aafa-5a6a856eee31 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:41.970572 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6695022c-e219-4074-aafa-5a6a856eee31 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:41.971273 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6695022c-e219-4074-aafa-5a6a856eee31 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:41.971695 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6695022c-e219-4074-aafa-5a6a856eee31 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:42.174914 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6695022c-e219-4074-aafa-5a6a856eee31 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:42.179194 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-64769169-c405-4269-a659-ea797a9eff4a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:42.182508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6695022c-e219-4074-aafa-5a6a856eee31 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.223230 Jul 20 11:36:42.183076 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 88/170] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:41 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:42.187020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-64769169-c405-4269-a659-ea797a9eff4a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.231344 Jul 20 11:36:42.187664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-78918c88-a04e-4baa-bb5e-2377f70d411c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:42.187792 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 83/171] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:41 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:42.188598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-78918c88-a04e-4baa-bb5e-2377f70d411c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:42.194669 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78918c88-a04e-4baa-bb5e-2377f70d411c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:42.195119 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78918c88-a04e-4baa-bb5e-2377f70d411c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:42.197761 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78918c88-a04e-4baa-bb5e-2377f70d411c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:42.198237 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78918c88-a04e-4baa-bb5e-2377f70d411c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:42.339162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-78918c88-a04e-4baa-bb5e-2377f70d411c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:42.346609 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-78918c88-a04e-4baa-bb5e-2377f70d411c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.162597 Jul 20 11:36:42.347241 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 89/172] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:42 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:43.199984 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c07078aa-7b38-4617-864f-eb0f9a9c4910 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:43.200684 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c07078aa-7b38-4617-864f-eb0f9a9c4910 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:43.203348 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-86b50a87-1e4b-46e7-aae6-ab647cc77157 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:43.203963 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-86b50a87-1e4b-46e7-aae6-ab647cc77157 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:43.207484 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c07078aa-7b38-4617-864f-eb0f9a9c4910 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:43.207923 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c07078aa-7b38-4617-864f-eb0f9a9c4910 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:43.208722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c07078aa-7b38-4617-864f-eb0f9a9c4910 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:43.209194 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c07078aa-7b38-4617-864f-eb0f9a9c4910 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:43.209961 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86b50a87-1e4b-46e7-aae6-ab647cc77157 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:43.210398 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86b50a87-1e4b-46e7-aae6-ab647cc77157 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:43.211154 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86b50a87-1e4b-46e7-aae6-ab647cc77157 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:43.211580 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-86b50a87-1e4b-46e7-aae6-ab647cc77157 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:43.413492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-86b50a87-1e4b-46e7-aae6-ab647cc77157 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:43.422482 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-86b50a87-1e4b-46e7-aae6-ab647cc77157 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.221502 Jul 20 11:36:43.423078 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 90/173] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:43 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:43.431281 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c07078aa-7b38-4617-864f-eb0f9a9c4910 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:43.444925 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3e891b7c-c34d-4ca8-b3cd-f8cffc0a399c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:43.444925 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3e891b7c-c34d-4ca8-b3cd-f8cffc0a399c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:43.445161 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c07078aa-7b38-4617-864f-eb0f9a9c4910 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.243850 Jul 20 11:36:43.445161 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 84/174] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:43 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:43.445371 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e891b7c-c34d-4ca8-b3cd-f8cffc0a399c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:43.445371 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e891b7c-c34d-4ca8-b3cd-f8cffc0a399c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:43.445371 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e891b7c-c34d-4ca8-b3cd-f8cffc0a399c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:43.445371 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e891b7c-c34d-4ca8-b3cd-f8cffc0a399c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:43.574640 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3e891b7c-c34d-4ca8-b3cd-f8cffc0a399c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:43.582302 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3e891b7c-c34d-4ca8-b3cd-f8cffc0a399c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.158143 Jul 20 11:36:43.582857 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 91/175] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:43 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:43.966319 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-32ae5def-1da2-4ce6-85de-411e9955af59 req-6b288c29-25c2-4296-9f3c-988373da6eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59b4f4f-d49c-4d6b-be00-331cddb9bfc2", "name": "network-vif-plugged", "status": "completed", "tag": "ca7da8b0-f849-4241-9124-9a117850f9e8"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:36:43.974612 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-32ae5def-1da2-4ce6-85de-411e9955af59 req-6b288c29-25c2-4296-9f3c-988373da6eb0 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:43.975056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-32ae5def-1da2-4ce6-85de-411e9955af59 req-6b288c29-25c2-4296-9f3c-988373da6eb0 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:43.986435 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-32ae5def-1da2-4ce6-85de-411e9955af59 req-6b288c29-25c2-4296-9f3c-988373da6eb0 service nova] Creating event network-vif-plugged:ca7da8b0-f849-4241-9124-9a117850f9e8 for instance e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 on hv-cinder-82282 Jul 20 11:36:43.991516 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-32ae5def-1da2-4ce6-85de-411e9955af59 req-6b288c29-25c2-4296-9f3c-988373da6eb0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029109 Jul 20 11:36:43.992129 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 85/176] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:36:44.440057 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2c710cdd-c030-448b-8f54-5a7a00248ef2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:44.440694 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2c710cdd-c030-448b-8f54-5a7a00248ef2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:44.446839 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c710cdd-c030-448b-8f54-5a7a00248ef2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:44.447277 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c710cdd-c030-448b-8f54-5a7a00248ef2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:44.448061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c710cdd-c030-448b-8f54-5a7a00248ef2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:44.448490 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2c710cdd-c030-448b-8f54-5a7a00248ef2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:44.457513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f73b28e1-fbed-4986-9a5b-51fe1636e30a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:44.458206 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f73b28e1-fbed-4986-9a5b-51fe1636e30a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:44.465095 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f73b28e1-fbed-4986-9a5b-51fe1636e30a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:44.465526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f73b28e1-fbed-4986-9a5b-51fe1636e30a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:44.466284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f73b28e1-fbed-4986-9a5b-51fe1636e30a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:44.466714 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f73b28e1-fbed-4986-9a5b-51fe1636e30a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:44.655101 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2c710cdd-c030-448b-8f54-5a7a00248ef2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:44.655795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f73b28e1-fbed-4986-9a5b-51fe1636e30a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:44.658763 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:44.661355 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2c710cdd-c030-448b-8f54-5a7a00248ef2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.225131 Jul 20 11:36:44.662213 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 92/177] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:44 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:44.671167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f73b28e1-fbed-4986-9a5b-51fe1636e30a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.211852 Jul 20 11:36:44.671167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 86/178] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:44 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:44.671167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-19e9dc33-067a-47b2-86d3-e0d26d09e679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:44.671167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-19e9dc33-067a-47b2-86d3-e0d26d09e679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:44.680045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19e9dc33-067a-47b2-86d3-e0d26d09e679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:44.680814 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19e9dc33-067a-47b2-86d3-e0d26d09e679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:44.681735 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19e9dc33-067a-47b2-86d3-e0d26d09e679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:44.682509 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-19e9dc33-067a-47b2-86d3-e0d26d09e679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:44.836106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-19e9dc33-067a-47b2-86d3-e0d26d09e679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:44.845069 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-19e9dc33-067a-47b2-86d3-e0d26d09e679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.178080 Jul 20 11:36:44.846245 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 87/179] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:44 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:45.678860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7356dfb2-ec79-4743-9a4e-112cf2682441 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:45.679446 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7356dfb2-ec79-4743-9a4e-112cf2682441 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:45.684073 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d520cdac-d996-40af-b11d-2c209068ff27 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:45.685678 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d520cdac-d996-40af-b11d-2c209068ff27 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:45.686298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7356dfb2-ec79-4743-9a4e-112cf2682441 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:45.686747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7356dfb2-ec79-4743-9a4e-112cf2682441 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:45.687518 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7356dfb2-ec79-4743-9a4e-112cf2682441 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:45.687954 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7356dfb2-ec79-4743-9a4e-112cf2682441 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:45.693357 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d520cdac-d996-40af-b11d-2c209068ff27 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:45.693357 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d520cdac-d996-40af-b11d-2c209068ff27 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:45.693357 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d520cdac-d996-40af-b11d-2c209068ff27 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:45.693770 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d520cdac-d996-40af-b11d-2c209068ff27 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:45.885603 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7356dfb2-ec79-4743-9a4e-112cf2682441 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:45.896221 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7356dfb2-ec79-4743-9a4e-112cf2682441 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.221019 Jul 20 11:36:45.897303 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 93/180] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:45 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:45.901798 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d520cdac-d996-40af-b11d-2c209068ff27 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:45.904152 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-36dd7215-1529-432e-98ba-fab62e6ad744 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:45.905174 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-36dd7215-1529-432e-98ba-fab62e6ad744 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:45.913059 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d520cdac-d996-40af-b11d-2c209068ff27 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.232825 Jul 20 11:36:45.926242 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 88/181] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:45 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:45.926670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36dd7215-1529-432e-98ba-fab62e6ad744 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:45.926670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36dd7215-1529-432e-98ba-fab62e6ad744 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:45.926670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36dd7215-1529-432e-98ba-fab62e6ad744 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:45.926670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-36dd7215-1529-432e-98ba-fab62e6ad744 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:46.075370 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-36dd7215-1529-432e-98ba-fab62e6ad744 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:46.082752 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-36dd7215-1529-432e-98ba-fab62e6ad744 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.184213 Jul 20 11:36:46.083262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 94/182] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:45 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:46.916029 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bf3cbf4a-a16d-4e63-a8d1-f26cdd149cef tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:46.916840 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bf3cbf4a-a16d-4e63-a8d1-f26cdd149cef tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:46.928260 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf3cbf4a-a16d-4e63-a8d1-f26cdd149cef tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:46.933283 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e66df81-2985-42ca-98af-2c6c03c68f3e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:46.933894 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2e66df81-2985-42ca-98af-2c6c03c68f3e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:46.937728 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf3cbf4a-a16d-4e63-a8d1-f26cdd149cef tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:46.938558 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf3cbf4a-a16d-4e63-a8d1-f26cdd149cef tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:46.938988 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf3cbf4a-a16d-4e63-a8d1-f26cdd149cef tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:46.946317 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e66df81-2985-42ca-98af-2c6c03c68f3e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:46.946767 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e66df81-2985-42ca-98af-2c6c03c68f3e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:46.947544 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e66df81-2985-42ca-98af-2c6c03c68f3e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:46.954625 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e66df81-2985-42ca-98af-2c6c03c68f3e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:47.178790 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf3cbf4a-a16d-4e63-a8d1-f26cdd149cef tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:47.181911 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2e66df81-2985-42ca-98af-2c6c03c68f3e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:47.187060 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bf3cbf4a-a16d-4e63-a8d1-f26cdd149cef tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.276996 Jul 20 11:36:47.190972 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 89/183] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:46 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:47.191086 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2e66df81-2985-42ca-98af-2c6c03c68f3e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.261676 Jul 20 11:36:47.200335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c8533f31-d4d8-426f-a64d-6203cadcbc5d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:47.200335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c8533f31-d4d8-426f-a64d-6203cadcbc5d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:47.200335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8533f31-d4d8-426f-a64d-6203cadcbc5d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:47.200335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8533f31-d4d8-426f-a64d-6203cadcbc5d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:47.200766 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8533f31-d4d8-426f-a64d-6203cadcbc5d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:47.200766 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8533f31-d4d8-426f-a64d-6203cadcbc5d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:47.201368 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 95/184] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:46 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:47.339932 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c8533f31-d4d8-426f-a64d-6203cadcbc5d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:47.349237 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c8533f31-d4d8-426f-a64d-6203cadcbc5d tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.160596 Jul 20 11:36:47.350998 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 90/185] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:47 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:48.204978 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5cd305e2-3830-4d24-bbe3-99e1a7bb2f25 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:48.205666 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5cd305e2-3830-4d24-bbe3-99e1a7bb2f25 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:48.208045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-57135b33-cbf5-45b5-a444-950d4422f2d9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:48.208709 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-57135b33-cbf5-45b5-a444-950d4422f2d9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:48.213307 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cd305e2-3830-4d24-bbe3-99e1a7bb2f25 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:48.213775 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cd305e2-3830-4d24-bbe3-99e1a7bb2f25 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:48.214652 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cd305e2-3830-4d24-bbe3-99e1a7bb2f25 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:48.215149 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5cd305e2-3830-4d24-bbe3-99e1a7bb2f25 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:48.215711 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57135b33-cbf5-45b5-a444-950d4422f2d9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:48.216311 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57135b33-cbf5-45b5-a444-950d4422f2d9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:48.217817 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57135b33-cbf5-45b5-a444-950d4422f2d9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:48.218251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-57135b33-cbf5-45b5-a444-950d4422f2d9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:48.423174 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-57135b33-cbf5-45b5-a444-950d4422f2d9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:48.431362 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-57135b33-cbf5-45b5-a444-950d4422f2d9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.227766 Jul 20 11:36:48.431939 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 91/186] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:48 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:48.434480 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5cd305e2-3830-4d24-bbe3-99e1a7bb2f25 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:48.436932 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7a1ee5ec-6576-49bc-9781-87f49c4ec6b3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:48.437847 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7a1ee5ec-6576-49bc-9781-87f49c4ec6b3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:48.443816 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a1ee5ec-6576-49bc-9781-87f49c4ec6b3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:48.444262 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a1ee5ec-6576-49bc-9781-87f49c4ec6b3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:48.444747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5cd305e2-3830-4d24-bbe3-99e1a7bb2f25 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.245152 Jul 20 11:36:48.445105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a1ee5ec-6576-49bc-9781-87f49c4ec6b3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:48.446057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a1ee5ec-6576-49bc-9781-87f49c4ec6b3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:48.446188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 96/187] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:48 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:48.578036 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7a1ee5ec-6576-49bc-9781-87f49c4ec6b3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:48.585577 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7a1ee5ec-6576-49bc-9781-87f49c4ec6b3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.152429 Jul 20 11:36:48.586120 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 92/188] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:48 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:49.447438 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bf10ba3d-f677-464a-8369-a62a9c2b2a4c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:49.448045 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bf10ba3d-f677-464a-8369-a62a9c2b2a4c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:49.454279 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf10ba3d-f677-464a-8369-a62a9c2b2a4c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:49.454802 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf10ba3d-f677-464a-8369-a62a9c2b2a4c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:49.455601 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf10ba3d-f677-464a-8369-a62a9c2b2a4c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:49.457679 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf10ba3d-f677-464a-8369-a62a9c2b2a4c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:49.473082 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6880453-b45f-4e42-bc6c-38d06bf8155b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:49.473082 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6880453-b45f-4e42-bc6c-38d06bf8155b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:49.474019 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6880453-b45f-4e42-bc6c-38d06bf8155b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:49.474469 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6880453-b45f-4e42-bc6c-38d06bf8155b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:49.475365 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6880453-b45f-4e42-bc6c-38d06bf8155b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:49.475812 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6880453-b45f-4e42-bc6c-38d06bf8155b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:49.669122 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bf10ba3d-f677-464a-8369-a62a9c2b2a4c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:49.673346 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6880453-b45f-4e42-bc6c-38d06bf8155b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:49.676881 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bf10ba3d-f677-464a-8369-a62a9c2b2a4c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.233304 Jul 20 11:36:49.677662 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 97/189] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:49 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:49.681445 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6880453-b45f-4e42-bc6c-38d06bf8155b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.222034 Jul 20 11:36:49.682391 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5d8fa18e-bc53-4068-b531-2863f324c9f1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:49.683212 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5d8fa18e-bc53-4068-b531-2863f324c9f1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:49.689664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d8fa18e-bc53-4068-b531-2863f324c9f1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:49.692133 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d8fa18e-bc53-4068-b531-2863f324c9f1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:49.692407 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 93/190] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:49 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:49.692515 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d8fa18e-bc53-4068-b531-2863f324c9f1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:49.692515 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d8fa18e-bc53-4068-b531-2863f324c9f1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:49.821948 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5d8fa18e-bc53-4068-b531-2863f324c9f1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:49.829288 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5d8fa18e-bc53-4068-b531-2863f324c9f1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.150503 Jul 20 11:36:49.829840 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 98/191] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:49 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:50.693521 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1266df04-350d-47c1-86ec-2da493ace7a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:50.694774 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1266df04-350d-47c1-86ec-2da493ace7a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:50.701713 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1266df04-350d-47c1-86ec-2da493ace7a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:50.702445 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1266df04-350d-47c1-86ec-2da493ace7a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:50.703406 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1266df04-350d-47c1-86ec-2da493ace7a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:50.704008 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1266df04-350d-47c1-86ec-2da493ace7a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:50.705115 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-76b10cc0-c1bf-4c2b-82e0-f73cc6917736 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:50.705880 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-76b10cc0-c1bf-4c2b-82e0-f73cc6917736 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:50.718450 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76b10cc0-c1bf-4c2b-82e0-f73cc6917736 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:50.720268 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76b10cc0-c1bf-4c2b-82e0-f73cc6917736 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:50.722750 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76b10cc0-c1bf-4c2b-82e0-f73cc6917736 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:50.723385 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-76b10cc0-c1bf-4c2b-82e0-f73cc6917736 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:51.203722 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-76b10cc0-c1bf-4c2b-82e0-f73cc6917736 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:51.213369 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-76b10cc0-c1bf-4c2b-82e0-f73cc6917736 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.515405 Jul 20 11:36:51.217691 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 99/192] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:50 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:51.222910 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1266df04-350d-47c1-86ec-2da493ace7a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:51.228002 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:51.235611 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1266df04-350d-47c1-86ec-2da493ace7a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.545307 Jul 20 11:36:51.238228 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-15a764d3-4b7e-403a-a14e-3513e4e957e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:51.238678 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 94/193] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:50 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:51.239358 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-15a764d3-4b7e-403a-a14e-3513e4e957e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:51.245717 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15a764d3-4b7e-403a-a14e-3513e4e957e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:51.246593 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15a764d3-4b7e-403a-a14e-3513e4e957e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:51.247738 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15a764d3-4b7e-403a-a14e-3513e4e957e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:51.248384 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15a764d3-4b7e-403a-a14e-3513e4e957e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:51.402812 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-15a764d3-4b7e-403a-a14e-3513e4e957e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:51.410419 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-15a764d3-4b7e-403a-a14e-3513e4e957e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.194474 Jul 20 11:36:51.411186 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 100/194] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:51 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:52.231433 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-81fc53f5-0395-4d81-95bf-bdcfd91f76c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:52.236875 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-81fc53f5-0395-4d81-95bf-bdcfd91f76c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:52.248286 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81fc53f5-0395-4d81-95bf-bdcfd91f76c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:52.248738 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81fc53f5-0395-4d81-95bf-bdcfd91f76c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:52.251021 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81fc53f5-0395-4d81-95bf-bdcfd91f76c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:52.251326 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-751bf03f-1eec-4ea4-ad48-a37c55a1b071 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:52.251880 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81fc53f5-0395-4d81-95bf-bdcfd91f76c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:52.251956 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-751bf03f-1eec-4ea4-ad48-a37c55a1b071 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:52.259979 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-751bf03f-1eec-4ea4-ad48-a37c55a1b071 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:52.260690 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-751bf03f-1eec-4ea4-ad48-a37c55a1b071 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:52.261652 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-751bf03f-1eec-4ea4-ad48-a37c55a1b071 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:52.262436 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-751bf03f-1eec-4ea4-ad48-a37c55a1b071 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:52.500822 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-751bf03f-1eec-4ea4-ad48-a37c55a1b071 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:52.510022 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-751bf03f-1eec-4ea4-ad48-a37c55a1b071 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.262402 Jul 20 11:36:52.510974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 101/195] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:52 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:52.516568 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d65ffc8b-1daf-488d-916f-02c272815171 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:52.517570 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d65ffc8b-1daf-488d-916f-02c272815171 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:52.524372 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d65ffc8b-1daf-488d-916f-02c272815171 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:52.525157 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d65ffc8b-1daf-488d-916f-02c272815171 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:52.526072 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d65ffc8b-1daf-488d-916f-02c272815171 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:52.526523 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d65ffc8b-1daf-488d-916f-02c272815171 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:52.540999 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-81fc53f5-0395-4d81-95bf-bdcfd91f76c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:52.553556 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-81fc53f5-0395-4d81-95bf-bdcfd91f76c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.326789 Jul 20 11:36:52.554837 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 95/196] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:52 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:52.618658 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-ca9fb511-7ce1-48d2-92dc-f0b1816e445e req-3f11264c-b38a-4d6c-a200-e2d0e1323203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a924d70d-5553-4f03-b899-e19681c65665", "name": "network-vif-plugged", "status": "completed", "tag": "e37711f1-e868-4bcd-9979-13231c875b65"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:36:52.627402 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-ca9fb511-7ce1-48d2-92dc-f0b1816e445e req-3f11264c-b38a-4d6c-a200-e2d0e1323203 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:52.628233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-ca9fb511-7ce1-48d2-92dc-f0b1816e445e req-3f11264c-b38a-4d6c-a200-e2d0e1323203 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:52.641691 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-ca9fb511-7ce1-48d2-92dc-f0b1816e445e req-3f11264c-b38a-4d6c-a200-e2d0e1323203 service nova] Creating event network-vif-plugged:e37711f1-e868-4bcd-9979-13231c875b65 for instance a924d70d-5553-4f03-b899-e19681c65665 on hv-cinder-82282 Jul 20 11:36:52.652830 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-ca9fb511-7ce1-48d2-92dc-f0b1816e445e req-3f11264c-b38a-4d6c-a200-e2d0e1323203 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033516 Jul 20 11:36:52.652830 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 96/197] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:36:52.696425 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d65ffc8b-1daf-488d-916f-02c272815171 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:52.714021 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d65ffc8b-1daf-488d-916f-02c272815171 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.201269 Jul 20 11:36:52.715501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 102/198] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:52 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:53.533018 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-feda19e9-e6ca-4e59-aadd-9dccd0c2347c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:53.533626 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-feda19e9-e6ca-4e59-aadd-9dccd0c2347c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:53.539668 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-feda19e9-e6ca-4e59-aadd-9dccd0c2347c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:53.540106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-feda19e9-e6ca-4e59-aadd-9dccd0c2347c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:53.540879 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-feda19e9-e6ca-4e59-aadd-9dccd0c2347c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:53.541308 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-feda19e9-e6ca-4e59-aadd-9dccd0c2347c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:53.576243 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f46e04aa-2fed-4c1c-951c-a011f261084d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:53.577219 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f46e04aa-2fed-4c1c-951c-a011f261084d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:53.584327 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f46e04aa-2fed-4c1c-951c-a011f261084d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:53.585139 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f46e04aa-2fed-4c1c-951c-a011f261084d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:53.586162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f46e04aa-2fed-4c1c-951c-a011f261084d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:53.587041 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f46e04aa-2fed-4c1c-951c-a011f261084d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:53.745452 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-feda19e9-e6ca-4e59-aadd-9dccd0c2347c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:53.763738 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-feda19e9-e6ca-4e59-aadd-9dccd0c2347c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.234899 Jul 20 11:36:53.766130 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 97/199] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:53 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:53.780507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d42933cd-f439-4f9e-8656-43f6b7358bdb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:53.781147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d42933cd-f439-4f9e-8656-43f6b7358bdb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:53.784270 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f46e04aa-2fed-4c1c-951c-a011f261084d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:53.787951 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d42933cd-f439-4f9e-8656-43f6b7358bdb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:53.788401 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d42933cd-f439-4f9e-8656-43f6b7358bdb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:53.789209 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d42933cd-f439-4f9e-8656-43f6b7358bdb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:53.789902 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d42933cd-f439-4f9e-8656-43f6b7358bdb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:53.792247 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f46e04aa-2fed-4c1c-951c-a011f261084d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.220064 Jul 20 11:36:53.792854 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 103/200] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:53 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:53.929705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d42933cd-f439-4f9e-8656-43f6b7358bdb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:53.940170 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d42933cd-f439-4f9e-8656-43f6b7358bdb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1322 microversion: 2.1 time: 0.172667 Jul 20 11:36:53.941412 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 98/201] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:53 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:54.661865 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-4ef3559f-84a8-4c99-a9db-fdabcee02f22 req-6129af85-1f31-4a4c-9dc5-88135bb1eedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19a7062-f17c-4693-9941-040c456d9bcf", "name": "network-vif-plugged", "status": "completed", "tag": "823be959-4c3b-4ce0-9838-c80d65b626cf"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:36:54.670780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-4ef3559f-84a8-4c99-a9db-fdabcee02f22 req-6129af85-1f31-4a4c-9dc5-88135bb1eedc service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:54.671637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-4ef3559f-84a8-4c99-a9db-fdabcee02f22 req-6129af85-1f31-4a4c-9dc5-88135bb1eedc service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:54.685206 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-4ef3559f-84a8-4c99-a9db-fdabcee02f22 req-6129af85-1f31-4a4c-9dc5-88135bb1eedc service nova] Creating event network-vif-plugged:823be959-4c3b-4ce0-9838-c80d65b626cf for instance e19a7062-f17c-4693-9941-040c456d9bcf on hv-cinder-82282 Jul 20 11:36:54.691178 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-4ef3559f-84a8-4c99-a9db-fdabcee02f22 req-6129af85-1f31-4a4c-9dc5-88135bb1eedc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033212 Jul 20 11:36:54.692726 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 104/202] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:36:54.783959 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0caee0a9-512b-4746-a8ce-4d427af5a60c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:54.784695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0caee0a9-512b-4746-a8ce-4d427af5a60c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:54.792176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0caee0a9-512b-4746-a8ce-4d427af5a60c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:54.792618 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0caee0a9-512b-4746-a8ce-4d427af5a60c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:54.793569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0caee0a9-512b-4746-a8ce-4d427af5a60c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:54.793998 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0caee0a9-512b-4746-a8ce-4d427af5a60c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:54.809799 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eaa3e947-e4de-4aab-ad1b-b661067c66b6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:54.810459 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eaa3e947-e4de-4aab-ad1b-b661067c66b6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:54.816687 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eaa3e947-e4de-4aab-ad1b-b661067c66b6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:54.817157 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eaa3e947-e4de-4aab-ad1b-b661067c66b6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:54.817923 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eaa3e947-e4de-4aab-ad1b-b661067c66b6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:54.818382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eaa3e947-e4de-4aab-ad1b-b661067c66b6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:55.009851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eaa3e947-e4de-4aab-ad1b-b661067c66b6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:55.017068 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0caee0a9-512b-4746-a8ce-4d427af5a60c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:55.024540 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eaa3e947-e4de-4aab-ad1b-b661067c66b6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.219496 Jul 20 11:36:55.024912 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0caee0a9-512b-4746-a8ce-4d427af5a60c tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.244790 Jul 20 11:36:55.025470 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 105/204] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:54 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:55.025601 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 99/204] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:54 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:55.029906 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-10f716da-04be-47b6-a2fe-2ae9c6043510 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:55.030534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-10f716da-04be-47b6-a2fe-2ae9c6043510 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:55.036581 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10f716da-04be-47b6-a2fe-2ae9c6043510 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:55.037060 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10f716da-04be-47b6-a2fe-2ae9c6043510 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:55.037814 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10f716da-04be-47b6-a2fe-2ae9c6043510 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:55.038251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-10f716da-04be-47b6-a2fe-2ae9c6043510 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:55.166725 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-10f716da-04be-47b6-a2fe-2ae9c6043510 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:55.174265 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-10f716da-04be-47b6-a2fe-2ae9c6043510 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1517 microversion: 2.1 time: 0.147851 Jul 20 11:36:55.174843 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 100/205] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:55 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1517 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:55.191386 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-363d07f2-a098-4a4b-a39b-6e7d16557b8c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:36:55.192407 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-363d07f2-a098-4a4b-a39b-6e7d16557b8c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:55.198423 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-363d07f2-a098-4a4b-a39b-6e7d16557b8c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:55.198861 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-363d07f2-a098-4a4b-a39b-6e7d16557b8c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:55.199612 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-363d07f2-a098-4a4b-a39b-6e7d16557b8c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:55.200041 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-363d07f2-a098-4a4b-a39b-6e7d16557b8c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:55.261254 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-363d07f2-a098-4a4b-a39b-6e7d16557b8c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lazy-loading 'flavor' on Instance uuid e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:36:55.615757 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-363d07f2-a098-4a4b-a39b-6e7d16557b8c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "POST /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2/action" status: 200 len: 32 microversion: 2.1 time: 0.428229 Jul 20 11:36:55.616378 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 106/206] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:36:55 2022] POST /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2/action => generated 32 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:36:55.628335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eebd591f-6a22-4ec6-801f-79acffe66ce2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:55.628335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eebd591f-6a22-4ec6-801f-79acffe66ce2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:55.632796 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eebd591f-6a22-4ec6-801f-79acffe66ce2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:55.633516 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eebd591f-6a22-4ec6-801f-79acffe66ce2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:55.634268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eebd591f-6a22-4ec6-801f-79acffe66ce2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:55.634740 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eebd591f-6a22-4ec6-801f-79acffe66ce2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:55.762394 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eebd591f-6a22-4ec6-801f-79acffe66ce2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:55.769750 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eebd591f-6a22-4ec6-801f-79acffe66ce2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.148356 Jul 20 11:36:55.770312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 101/207] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:55 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:56.042452 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-263a3e06-ea90-4a5c-84f4-2452d8b8601a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:56.043132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-263a3e06-ea90-4a5c-84f4-2452d8b8601a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:56.047172 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-799be674-c73a-4f55-831a-a00a4d580f86 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:56.047957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-799be674-c73a-4f55-831a-a00a4d580f86 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:56.049399 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-263a3e06-ea90-4a5c-84f4-2452d8b8601a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:56.049843 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-263a3e06-ea90-4a5c-84f4-2452d8b8601a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:56.050603 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-263a3e06-ea90-4a5c-84f4-2452d8b8601a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:56.051944 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-263a3e06-ea90-4a5c-84f4-2452d8b8601a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:56.053932 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-799be674-c73a-4f55-831a-a00a4d580f86 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:56.054376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-799be674-c73a-4f55-831a-a00a4d580f86 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:56.055164 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-799be674-c73a-4f55-831a-a00a4d580f86 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:56.055595 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-799be674-c73a-4f55-831a-a00a4d580f86 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:56.247368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-799be674-c73a-4f55-831a-a00a4d580f86 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:56.251484 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-263a3e06-ea90-4a5c-84f4-2452d8b8601a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:56.254647 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-799be674-c73a-4f55-831a-a00a4d580f86 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.211263 Jul 20 11:36:56.255218 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 102/208] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:56 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:56.259260 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-263a3e06-ea90-4a5c-84f4-2452d8b8601a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.221046 Jul 20 11:36:56.260363 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 107/209] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:56 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:56.788112 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c7392125-1fc2-458b-bf2f-02dc561aa01f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:56.788718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c7392125-1fc2-458b-bf2f-02dc561aa01f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:56.795128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7392125-1fc2-458b-bf2f-02dc561aa01f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:56.795569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7392125-1fc2-458b-bf2f-02dc561aa01f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:56.796321 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7392125-1fc2-458b-bf2f-02dc561aa01f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:56.796750 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7392125-1fc2-458b-bf2f-02dc561aa01f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:56.924585 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c7392125-1fc2-458b-bf2f-02dc561aa01f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:56.931806 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c7392125-1fc2-458b-bf2f-02dc561aa01f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.147464 Jul 20 11:36:56.932371 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 103/210] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:56 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:57.272573 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-49e6d14e-c9da-4caa-9888-c9f06acffdb4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:57.273199 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-49e6d14e-c9da-4caa-9888-c9f06acffdb4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:57.276866 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b5d12812-a007-4bf7-a361-ea13bd1d8145 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:57.277482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b5d12812-a007-4bf7-a361-ea13bd1d8145 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:57.279415 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=76 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:57.279845 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49e6d14e-c9da-4caa-9888-c9f06acffdb4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:57.280293 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49e6d14e-c9da-4caa-9888-c9f06acffdb4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:57.281082 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49e6d14e-c9da-4caa-9888-c9f06acffdb4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:57.281512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-49e6d14e-c9da-4caa-9888-c9f06acffdb4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:57.284266 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5d12812-a007-4bf7-a361-ea13bd1d8145 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:57.284709 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5d12812-a007-4bf7-a361-ea13bd1d8145 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:57.285489 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:57.285619 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5d12812-a007-4bf7-a361-ea13bd1d8145 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:57.285917 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5d12812-a007-4bf7-a361-ea13bd1d8145 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:57.479763 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-49e6d14e-c9da-4caa-9888-c9f06acffdb4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:57.486164 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b5d12812-a007-4bf7-a361-ea13bd1d8145 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:57.487515 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-49e6d14e-c9da-4caa-9888-c9f06acffdb4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.218796 Jul 20 11:36:57.488085 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 108/211] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:57 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:57.496154 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b5d12812-a007-4bf7-a361-ea13bd1d8145 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.223453 Jul 20 11:36:57.496837 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 104/212] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:57 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:57.949180 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ae7ebb05-396d-4a07-9bfd-bf3fb7e7400f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:57.949717 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ae7ebb05-396d-4a07-9bfd-bf3fb7e7400f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:57.955713 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae7ebb05-396d-4a07-9bfd-bf3fb7e7400f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:57.956159 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae7ebb05-396d-4a07-9bfd-bf3fb7e7400f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:57.956945 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae7ebb05-396d-4a07-9bfd-bf3fb7e7400f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:57.957380 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae7ebb05-396d-4a07-9bfd-bf3fb7e7400f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:58.084393 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ae7ebb05-396d-4a07-9bfd-bf3fb7e7400f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:58.092126 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ae7ebb05-396d-4a07-9bfd-bf3fb7e7400f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.147599 Jul 20 11:36:58.092690 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 109/213] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:57 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:58.504047 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a48549f3-b70b-4346-b594-35b190621034 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:58.504653 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a48549f3-b70b-4346-b594-35b190621034 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:58.511358 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a48549f3-b70b-4346-b594-35b190621034 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:58.511808 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a48549f3-b70b-4346-b594-35b190621034 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:58.512570 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a48549f3-b70b-4346-b594-35b190621034 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:58.513037 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a48549f3-b70b-4346-b594-35b190621034 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:58.513164 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-53039975-24e3-450c-89fa-e02fe46234a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:58.513734 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-53039975-24e3-450c-89fa-e02fe46234a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:58.520007 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-53039975-24e3-450c-89fa-e02fe46234a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:58.520456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-53039975-24e3-450c-89fa-e02fe46234a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:58.521251 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-53039975-24e3-450c-89fa-e02fe46234a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:58.521694 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-53039975-24e3-450c-89fa-e02fe46234a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:58.708389 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a48549f3-b70b-4346-b594-35b190621034 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:58.712996 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-53039975-24e3-450c-89fa-e02fe46234a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:58.716675 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a48549f3-b70b-4346-b594-35b190621034 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.216431 Jul 20 11:36:58.717273 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 105/214] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:58 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:36:58.720424 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-53039975-24e3-450c-89fa-e02fe46234a1 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.211029 Jul 20 11:36:58.721014 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 110/215] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:58 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:59.109566 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a44aed1e-a526-4e06-9c10-17ac14dfed4b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:59.110191 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a44aed1e-a526-4e06-9c10-17ac14dfed4b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:59.116439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a44aed1e-a526-4e06-9c10-17ac14dfed4b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:59.116983 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a44aed1e-a526-4e06-9c10-17ac14dfed4b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:59.117757 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a44aed1e-a526-4e06-9c10-17ac14dfed4b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:59.118193 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a44aed1e-a526-4e06-9c10-17ac14dfed4b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:59.249918 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a44aed1e-a526-4e06-9c10-17ac14dfed4b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:36:59.257651 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a44aed1e-a526-4e06-9c10-17ac14dfed4b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.152280 Jul 20 11:36:59.258475 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 106/216] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:59 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:36:59.735657 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fec8b2f2-c647-47fb-a6bd-8c94e03e199f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:59.737102 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fec8b2f2-c647-47fb-a6bd-8c94e03e199f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:59.741116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ed24a155-1f8a-4f25-bb5b-eb3b0d43a17e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:59.742005 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ed24a155-1f8a-4f25-bb5b-eb3b0d43a17e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:36:59.744805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=78 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:59.746919 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fec8b2f2-c647-47fb-a6bd-8c94e03e199f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:59.747363 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fec8b2f2-c647-47fb-a6bd-8c94e03e199f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:59.750893 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed24a155-1f8a-4f25-bb5b-eb3b0d43a17e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:59.751787 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed24a155-1f8a-4f25-bb5b-eb3b0d43a17e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:59.752630 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed24a155-1f8a-4f25-bb5b-eb3b0d43a17e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:59.753196 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed24a155-1f8a-4f25-bb5b-eb3b0d43a17e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:59.754172 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fec8b2f2-c647-47fb-a6bd-8c94e03e199f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:59.754677 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fec8b2f2-c647-47fb-a6bd-8c94e03e199f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:00.002334 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fec8b2f2-c647-47fb-a6bd-8c94e03e199f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:00.007474 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ed24a155-1f8a-4f25-bb5b-eb3b0d43a17e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:00.011786 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fec8b2f2-c647-47fb-a6bd-8c94e03e199f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.281073 Jul 20 11:37:00.012583 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 111/217] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:59 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:00.016918 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ed24a155-1f8a-4f25-bb5b-eb3b0d43a17e tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.282566 Jul 20 11:37:00.017584 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 107/218] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:36:59 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:00.275751 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2164943b-e6bc-4069-b1c9-e53faf795932 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:00.276259 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2164943b-e6bc-4069-b1c9-e53faf795932 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:00.282704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2164943b-e6bc-4069-b1c9-e53faf795932 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:00.283151 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2164943b-e6bc-4069-b1c9-e53faf795932 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:00.283912 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2164943b-e6bc-4069-b1c9-e53faf795932 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:00.284348 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2164943b-e6bc-4069-b1c9-e53faf795932 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:00.420759 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2164943b-e6bc-4069-b1c9-e53faf795932 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:00.428132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2164943b-e6bc-4069-b1c9-e53faf795932 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.156846 Jul 20 11:37:00.428696 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 112/219] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:00 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:01.029476 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e28c0818-98ad-489e-a5af-86cc35349171 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:01.030085 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e28c0818-98ad-489e-a5af-86cc35349171 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:01.034567 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-90410aef-dca0-47aa-8b11-3c9cd88eeb71 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:01.035331 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-90410aef-dca0-47aa-8b11-3c9cd88eeb71 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:01.036769 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e28c0818-98ad-489e-a5af-86cc35349171 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:01.037242 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e28c0818-98ad-489e-a5af-86cc35349171 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:01.038008 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e28c0818-98ad-489e-a5af-86cc35349171 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:01.038655 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e28c0818-98ad-489e-a5af-86cc35349171 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:01.042687 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90410aef-dca0-47aa-8b11-3c9cd88eeb71 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:01.043405 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90410aef-dca0-47aa-8b11-3c9cd88eeb71 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:01.047926 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90410aef-dca0-47aa-8b11-3c9cd88eeb71 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:01.047926 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90410aef-dca0-47aa-8b11-3c9cd88eeb71 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:01.300537 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e28c0818-98ad-489e-a5af-86cc35349171 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:01.307975 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e28c0818-98ad-489e-a5af-86cc35349171 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.282644 Jul 20 11:37:01.308546 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 108/220] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:01 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:01.321120 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90410aef-dca0-47aa-8b11-3c9cd88eeb71 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:01.338569 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-90410aef-dca0-47aa-8b11-3c9cd88eeb71 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1315 microversion: 2.1 time: 0.307325 Jul 20 11:37:01.339677 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 113/221] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:01 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:01.443935 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ff7097f1-7073-4112-88d0-8a90321d8b94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:01.444547 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ff7097f1-7073-4112-88d0-8a90321d8b94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:01.451303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff7097f1-7073-4112-88d0-8a90321d8b94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:01.451750 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff7097f1-7073-4112-88d0-8a90321d8b94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:01.452519 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff7097f1-7073-4112-88d0-8a90321d8b94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:01.452985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ff7097f1-7073-4112-88d0-8a90321d8b94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:01.588538 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ff7097f1-7073-4112-88d0-8a90321d8b94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:01.596601 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ff7097f1-7073-4112-88d0-8a90321d8b94 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.156529 Jul 20 11:37:01.597198 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 109/222] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:01 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:02.327551 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-02f67d64-74c3-49f3-aa70-fe07ddaa43bd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:02.333559 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-02f67d64-74c3-49f3-aa70-fe07ddaa43bd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:02.341779 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02f67d64-74c3-49f3-aa70-fe07ddaa43bd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:02.342347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02f67d64-74c3-49f3-aa70-fe07ddaa43bd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:02.343264 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02f67d64-74c3-49f3-aa70-fe07ddaa43bd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:02.343859 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02f67d64-74c3-49f3-aa70-fe07ddaa43bd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:02.356714 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-27745099-b843-4f98-9c59-b6052789630b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:02.366608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-27745099-b843-4f98-9c59-b6052789630b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:02.368991 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27745099-b843-4f98-9c59-b6052789630b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:02.369688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27745099-b843-4f98-9c59-b6052789630b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:02.370465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27745099-b843-4f98-9c59-b6052789630b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:02.373166 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27745099-b843-4f98-9c59-b6052789630b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:02.615134 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-02f67d64-74c3-49f3-aa70-fe07ddaa43bd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:02.623095 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-02f67d64-74c3-49f3-aa70-fe07ddaa43bd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1365 microversion: 2.1 time: 0.302141 Jul 20 11:37:02.623680 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 114/223] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:02 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1365 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:02.628438 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-132c2ca5-eab6-4888-b2c0-9e7723d02e34 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:02.629247 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-132c2ca5-eab6-4888-b2c0-9e7723d02e34 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:02.636706 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-132c2ca5-eab6-4888-b2c0-9e7723d02e34 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:02.637499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-132c2ca5-eab6-4888-b2c0-9e7723d02e34 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:02.638277 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-132c2ca5-eab6-4888-b2c0-9e7723d02e34 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:02.638479 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-27745099-b843-4f98-9c59-b6052789630b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:02.638865 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-132c2ca5-eab6-4888-b2c0-9e7723d02e34 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:02.649146 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-27745099-b843-4f98-9c59-b6052789630b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1503 microversion: 2.1 time: 0.296946 Jul 20 11:37:02.662012 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 110/224] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:02 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:37:02.818644 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-132c2ca5-eab6-4888-b2c0-9e7723d02e34 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:02.827884 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-132c2ca5-eab6-4888-b2c0-9e7723d02e34 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.203051 Jul 20 11:37:02.834888 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 115/225] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:02 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:03.640040 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-df5a64c9-2ead-4aab-9b5f-b49e87555a53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:03.640653 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-df5a64c9-2ead-4aab-9b5f-b49e87555a53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:03.648438 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df5a64c9-2ead-4aab-9b5f-b49e87555a53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:03.648951 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df5a64c9-2ead-4aab-9b5f-b49e87555a53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:03.649754 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df5a64c9-2ead-4aab-9b5f-b49e87555a53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:03.651431 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df5a64c9-2ead-4aab-9b5f-b49e87555a53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:03.838180 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-df5a64c9-2ead-4aab-9b5f-b49e87555a53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:03.847434 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-df5a64c9-2ead-4aab-9b5f-b49e87555a53 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1554 microversion: 2.1 time: 0.211218 Jul 20 11:37:03.851409 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 111/226] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:03 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:03.851529 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fea5504e-e909-43c0-bd92-f4387273fce5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:03.851529 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fea5504e-e909-43c0-bd92-f4387273fce5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:03.862779 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fea5504e-e909-43c0-bd92-f4387273fce5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:03.863565 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fea5504e-e909-43c0-bd92-f4387273fce5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:03.864745 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fea5504e-e909-43c0-bd92-f4387273fce5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:03.864957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cb2c6d70-61f9-418d-ba60-e605feabc9ac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:03.865617 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cb2c6d70-61f9-418d-ba60-e605feabc9ac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:03.865751 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fea5504e-e909-43c0-bd92-f4387273fce5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:03.875741 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb2c6d70-61f9-418d-ba60-e605feabc9ac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:03.876506 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb2c6d70-61f9-418d-ba60-e605feabc9ac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:03.878926 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb2c6d70-61f9-418d-ba60-e605feabc9ac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:03.879555 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb2c6d70-61f9-418d-ba60-e605feabc9ac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:03.907965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:04.044751 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cb2c6d70-61f9-418d-ba60-e605feabc9ac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183556 Jul 20 11:37:04.045691 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 112/227] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 11:37:03 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:37:04.321518 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fea5504e-e909-43c0-bd92-f4387273fce5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:04.331301 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fea5504e-e909-43c0-bd92-f4387273fce5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.486086 Jul 20 11:37:04.336937 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 116/228] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:03 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:37:05.349370 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fee7801b-1f81-4f1e-b77a-5719851178d6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:05.349991 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fee7801b-1f81-4f1e-b77a-5719851178d6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:05.356978 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fee7801b-1f81-4f1e-b77a-5719851178d6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:05.357424 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fee7801b-1f81-4f1e-b77a-5719851178d6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:05.358503 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fee7801b-1f81-4f1e-b77a-5719851178d6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:05.358819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fee7801b-1f81-4f1e-b77a-5719851178d6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:05.508323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fee7801b-1f81-4f1e-b77a-5719851178d6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:05.516675 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fee7801b-1f81-4f1e-b77a-5719851178d6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.171894 Jul 20 11:37:05.517365 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 113/229] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:05 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:05.700115 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ad6f9166-5373-4ca6-a7ac-2e4503670582 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe57eaf4-bdb1-4fb3-8577-a5ed94ae5f7c"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:05.702177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ad6f9166-5373-4ca6-a7ac-2e4503670582 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:05.710021 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad6f9166-5373-4ca6-a7ac-2e4503670582 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:05.710965 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad6f9166-5373-4ca6-a7ac-2e4503670582 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:05.712171 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad6f9166-5373-4ca6-a7ac-2e4503670582 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:05.713486 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ad6f9166-5373-4ca6-a7ac-2e4503670582 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:05.750104 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-7d5e672b-e70d-441a-9ba9-f99447b86499 req-280636f9-7b79-4cb4-b817-7cd5d7b7f19d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19a7062-f17c-4693-9941-040c456d9bcf", "tag": "823be959-4c3b-4ce0-9838-c80d65b626cf"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:05.759861 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-7d5e672b-e70d-441a-9ba9-f99447b86499 req-280636f9-7b79-4cb4-b817-7cd5d7b7f19d service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:05.760298 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-7d5e672b-e70d-441a-9ba9-f99447b86499 req-280636f9-7b79-4cb4-b817-7cd5d7b7f19d service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:05.773741 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-7d5e672b-e70d-441a-9ba9-f99447b86499 req-280636f9-7b79-4cb4-b817-7cd5d7b7f19d service nova] Creating event network-changed:823be959-4c3b-4ce0-9838-c80d65b626cf for instance e19a7062-f17c-4693-9941-040c456d9bcf on hv-cinder-82282 Jul 20 11:37:05.790010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-7d5e672b-e70d-441a-9ba9-f99447b86499 req-280636f9-7b79-4cb4-b817-7cd5d7b7f19d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043689 Jul 20 11:37:05.792059 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 114/230] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:37:06.537288 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9f3d1f21-b4d2-418e-b382-57212efc25e1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:06.538188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9f3d1f21-b4d2-418e-b382-57212efc25e1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:06.553518 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f3d1f21-b4d2-418e-b382-57212efc25e1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:06.554864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f3d1f21-b4d2-418e-b382-57212efc25e1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:06.560144 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f3d1f21-b4d2-418e-b382-57212efc25e1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:06.560144 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f3d1f21-b4d2-418e-b382-57212efc25e1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:06.777542 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f3d1f21-b4d2-418e-b382-57212efc25e1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:06.793907 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ad6f9166-5373-4ca6-a7ac-2e4503670582 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "POST /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.088087 Jul 20 11:37:06.793907 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 117/231] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:37:05 2022] POST /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665/os-volume_attachments => generated 194 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:37:06.798322 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9f3d1f21-b4d2-418e-b382-57212efc25e1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.267751 Jul 20 11:37:06.799170 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 115/232] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:06 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:07.815832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4e4a5e6f-9ad9-4118-acfe-4903024fa21f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:07.816547 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4e4a5e6f-9ad9-4118-acfe-4903024fa21f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:07.824247 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e4a5e6f-9ad9-4118-acfe-4903024fa21f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:07.824685 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e4a5e6f-9ad9-4118-acfe-4903024fa21f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:07.825684 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e4a5e6f-9ad9-4118-acfe-4903024fa21f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:07.826335 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e4a5e6f-9ad9-4118-acfe-4903024fa21f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:07.971259 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e4a5e6f-9ad9-4118-acfe-4903024fa21f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:07.979720 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4e4a5e6f-9ad9-4118-acfe-4903024fa21f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.168214 Jul 20 11:37:07.980303 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 118/233] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:07 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:08.997172 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cdc1b562-1466-4713-b99b-7be1f0ce5248 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:08.997783 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cdc1b562-1466-4713-b99b-7be1f0ce5248 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:09.003776 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdc1b562-1466-4713-b99b-7be1f0ce5248 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:09.004224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdc1b562-1466-4713-b99b-7be1f0ce5248 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:09.007277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdc1b562-1466-4713-b99b-7be1f0ce5248 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:09.007277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cdc1b562-1466-4713-b99b-7be1f0ce5248 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:09.142979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cdc1b562-1466-4713-b99b-7be1f0ce5248 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:09.150719 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cdc1b562-1466-4713-b99b-7be1f0ce5248 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.157914 Jul 20 11:37:09.151295 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 116/234] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:08 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:10.167924 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-55dcbda6-11ae-437c-a4a9-c37d2d2329fe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:10.168527 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-55dcbda6-11ae-437c-a4a9-c37d2d2329fe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:10.175285 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55dcbda6-11ae-437c-a4a9-c37d2d2329fe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:10.175732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55dcbda6-11ae-437c-a4a9-c37d2d2329fe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:10.176501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55dcbda6-11ae-437c-a4a9-c37d2d2329fe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:10.176964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-55dcbda6-11ae-437c-a4a9-c37d2d2329fe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:10.311281 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-55dcbda6-11ae-437c-a4a9-c37d2d2329fe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:10.318416 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-55dcbda6-11ae-437c-a4a9-c37d2d2329fe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.154778 Jul 20 11:37:10.318983 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 119/235] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:10 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:11.335407 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8b8e07d1-f5dc-4415-bab3-581af93b76ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:11.336064 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8b8e07d1-f5dc-4415-bab3-581af93b76ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:11.342104 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b8e07d1-f5dc-4415-bab3-581af93b76ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:11.342547 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b8e07d1-f5dc-4415-bab3-581af93b76ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:11.343303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b8e07d1-f5dc-4415-bab3-581af93b76ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:11.343739 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b8e07d1-f5dc-4415-bab3-581af93b76ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:11.481689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8b8e07d1-f5dc-4415-bab3-581af93b76ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:11.489117 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8b8e07d1-f5dc-4415-bab3-581af93b76ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.157480 Jul 20 11:37:11.490077 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 117/236] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:11 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:12.506029 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3dc2f426-1247-4d9a-b6de-57f4ed4fbeb0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:12.506606 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3dc2f426-1247-4d9a-b6de-57f4ed4fbeb0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:12.513901 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dc2f426-1247-4d9a-b6de-57f4ed4fbeb0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:12.514355 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dc2f426-1247-4d9a-b6de-57f4ed4fbeb0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:12.515123 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dc2f426-1247-4d9a-b6de-57f4ed4fbeb0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:12.515563 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dc2f426-1247-4d9a-b6de-57f4ed4fbeb0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:12.658796 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3dc2f426-1247-4d9a-b6de-57f4ed4fbeb0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:12.667508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3dc2f426-1247-4d9a-b6de-57f4ed4fbeb0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.165196 Jul 20 11:37:12.668121 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 120/237] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:12 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:13.686910 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b4c19294-207c-4db7-947c-10e25a66e51a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:13.687746 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b4c19294-207c-4db7-947c-10e25a66e51a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:13.694324 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4c19294-207c-4db7-947c-10e25a66e51a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:13.694787 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4c19294-207c-4db7-947c-10e25a66e51a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:13.696028 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4c19294-207c-4db7-947c-10e25a66e51a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:13.696501 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b4c19294-207c-4db7-947c-10e25a66e51a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:13.831589 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b4c19294-207c-4db7-947c-10e25a66e51a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:13.840129 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b4c19294-207c-4db7-947c-10e25a66e51a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.156986 Jul 20 11:37:13.840868 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 118/238] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:13 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:14.864821 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ef2cf474-8d92-4335-abd9-080239251548 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:14.864821 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ef2cf474-8d92-4335-abd9-080239251548 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:14.874027 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef2cf474-8d92-4335-abd9-080239251548 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:14.875435 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef2cf474-8d92-4335-abd9-080239251548 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:14.876508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef2cf474-8d92-4335-abd9-080239251548 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:14.877297 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef2cf474-8d92-4335-abd9-080239251548 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:15.007161 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ef2cf474-8d92-4335-abd9-080239251548 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:15.015473 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ef2cf474-8d92-4335-abd9-080239251548 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.157902 Jul 20 11:37:15.016041 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 121/239] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:14 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:16.032333 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9220ad72-a8da-461c-928a-481545b36b71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:16.032944 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9220ad72-a8da-461c-928a-481545b36b71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:16.039093 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9220ad72-a8da-461c-928a-481545b36b71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:16.039543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9220ad72-a8da-461c-928a-481545b36b71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:16.040324 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9220ad72-a8da-461c-928a-481545b36b71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:16.040757 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9220ad72-a8da-461c-928a-481545b36b71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:16.250979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9220ad72-a8da-461c-928a-481545b36b71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:16.262288 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9220ad72-a8da-461c-928a-481545b36b71 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.233868 Jul 20 11:37:16.264010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 119/240] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:16 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:17.279665 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3aa30a59-e2e3-47a3-ad29-e75a3656b737 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:17.281049 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3aa30a59-e2e3-47a3-ad29-e75a3656b737 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:17.288661 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3aa30a59-e2e3-47a3-ad29-e75a3656b737 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:17.289449 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3aa30a59-e2e3-47a3-ad29-e75a3656b737 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:17.290520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3aa30a59-e2e3-47a3-ad29-e75a3656b737 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:17.291166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3aa30a59-e2e3-47a3-ad29-e75a3656b737 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:17.301075 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2e09fc65-26ac-4cdb-87df-5ea99d36cf80 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:17.303262 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2e09fc65-26ac-4cdb-87df-5ea99d36cf80 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:17.310714 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e09fc65-26ac-4cdb-87df-5ea99d36cf80 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:17.311531 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e09fc65-26ac-4cdb-87df-5ea99d36cf80 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:17.319339 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e09fc65-26ac-4cdb-87df-5ea99d36cf80 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:17.319339 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e09fc65-26ac-4cdb-87df-5ea99d36cf80 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:17.349231 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2e09fc65-26ac-4cdb-87df-5ea99d36cf80 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:37:17.531566 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3aa30a59-e2e3-47a3-ad29-e75a3656b737 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:17.535379 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3aa30a59-e2e3-47a3-ad29-e75a3656b737 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.259675 Jul 20 11:37:17.535953 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 122/241] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:17 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:17.800485 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2e09fc65-26ac-4cdb-87df-5ea99d36cf80 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 204 len: 0 microversion: 2.1 time: 0.503772 Jul 20 11:37:17.801432 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 120/242] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:37:17 2022] DELETE /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:37:17.810341 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-21a46c41-c837-4dad-8de6-76bcd4a7cb02 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:17.811238 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-21a46c41-c837-4dad-8de6-76bcd4a7cb02 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:17.819858 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21a46c41-c837-4dad-8de6-76bcd4a7cb02 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:17.820638 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21a46c41-c837-4dad-8de6-76bcd4a7cb02 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:17.821733 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21a46c41-c837-4dad-8de6-76bcd4a7cb02 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:17.822182 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21a46c41-c837-4dad-8de6-76bcd4a7cb02 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:17.844897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:18.264522 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-21a46c41-c837-4dad-8de6-76bcd4a7cb02 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:18.293045 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-21a46c41-c837-4dad-8de6-76bcd4a7cb02 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1555 microversion: 2.1 time: 0.470872 Jul 20 11:37:18.294366 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 123/243] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:17 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1555 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:37:18.556197 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eec0dd7f-0709-4aa0-bff6-1fbd22225cd2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:18.564106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eec0dd7f-0709-4aa0-bff6-1fbd22225cd2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:18.564106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eec0dd7f-0709-4aa0-bff6-1fbd22225cd2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:18.564576 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eec0dd7f-0709-4aa0-bff6-1fbd22225cd2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:18.565820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eec0dd7f-0709-4aa0-bff6-1fbd22225cd2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:18.566480 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eec0dd7f-0709-4aa0-bff6-1fbd22225cd2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:18.768923 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eec0dd7f-0709-4aa0-bff6-1fbd22225cd2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:18.783956 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eec0dd7f-0709-4aa0-bff6-1fbd22225cd2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.234546 Jul 20 11:37:18.786637 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 121/244] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:18 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:19.311904 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-360b2830-0511-414a-bbed-a3f4ee6db3d0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:19.313125 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-360b2830-0511-414a-bbed-a3f4ee6db3d0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:19.331202 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-360b2830-0511-414a-bbed-a3f4ee6db3d0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:19.332013 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-360b2830-0511-414a-bbed-a3f4ee6db3d0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:19.332965 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-360b2830-0511-414a-bbed-a3f4ee6db3d0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:19.333536 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-360b2830-0511-414a-bbed-a3f4ee6db3d0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:19.561288 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-360b2830-0511-414a-bbed-a3f4ee6db3d0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:19.569881 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-360b2830-0511-414a-bbed-a3f4ee6db3d0 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1555 microversion: 2.1 time: 0.261736 Jul 20 11:37:19.575154 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 124/245] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:19 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1555 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:19.802151 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f4ed5260-8cec-4c66-8cf4-74ea54c0b585 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:19.803382 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f4ed5260-8cec-4c66-8cf4-74ea54c0b585 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:19.810338 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4ed5260-8cec-4c66-8cf4-74ea54c0b585 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:19.810981 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4ed5260-8cec-4c66-8cf4-74ea54c0b585 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:19.811955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4ed5260-8cec-4c66-8cf4-74ea54c0b585 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:19.812540 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f4ed5260-8cec-4c66-8cf4-74ea54c0b585 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:20.087591 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f4ed5260-8cec-4c66-8cf4-74ea54c0b585 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:20.117826 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f4ed5260-8cec-4c66-8cf4-74ea54c0b585 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.319780 Jul 20 11:37:20.128262 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 122/246] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:19 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:20.590502 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e304d29b-0ab0-4dc2-8647-d4aec64459f7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:20.591199 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e304d29b-0ab0-4dc2-8647-d4aec64459f7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:20.600772 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e304d29b-0ab0-4dc2-8647-d4aec64459f7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:20.601491 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e304d29b-0ab0-4dc2-8647-d4aec64459f7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:20.603809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e304d29b-0ab0-4dc2-8647-d4aec64459f7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:20.604436 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e304d29b-0ab0-4dc2-8647-d4aec64459f7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:20.811402 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e304d29b-0ab0-4dc2-8647-d4aec64459f7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:20.820545 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e304d29b-0ab0-4dc2-8647-d4aec64459f7 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1555 microversion: 2.1 time: 0.233873 Jul 20 11:37:20.821202 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 125/247] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:20 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:21.135810 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a6836eb-b7f5-4632-a561-7c4b8371788e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:21.137888 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a6836eb-b7f5-4632-a561-7c4b8371788e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:21.144611 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a6836eb-b7f5-4632-a561-7c4b8371788e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:21.145488 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a6836eb-b7f5-4632-a561-7c4b8371788e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:21.146544 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a6836eb-b7f5-4632-a561-7c4b8371788e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:21.147134 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a6836eb-b7f5-4632-a561-7c4b8371788e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:21.330711 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0a6836eb-b7f5-4632-a561-7c4b8371788e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:21.338810 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a6836eb-b7f5-4632-a561-7c4b8371788e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.207336 Jul 20 11:37:21.339370 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 123/248] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:21 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:21.837675 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56def48b-8c88-4bbb-a41d-087ddc1feaa2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:21.838494 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56def48b-8c88-4bbb-a41d-087ddc1feaa2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:21.845117 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56def48b-8c88-4bbb-a41d-087ddc1feaa2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:21.845571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56def48b-8c88-4bbb-a41d-087ddc1feaa2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:21.846349 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56def48b-8c88-4bbb-a41d-087ddc1feaa2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:21.848619 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56def48b-8c88-4bbb-a41d-087ddc1feaa2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:22.011152 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56def48b-8c88-4bbb-a41d-087ddc1feaa2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:22.019042 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56def48b-8c88-4bbb-a41d-087ddc1feaa2 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1555 microversion: 2.1 time: 0.185221 Jul 20 11:37:22.019831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 126/249] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:21 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:22.356104 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1bbdbb92-4b5b-4168-9dd3-3fda77d0be67 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:22.356715 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1bbdbb92-4b5b-4168-9dd3-3fda77d0be67 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:22.363392 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bbdbb92-4b5b-4168-9dd3-3fda77d0be67 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:22.364128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bbdbb92-4b5b-4168-9dd3-3fda77d0be67 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:22.365105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bbdbb92-4b5b-4168-9dd3-3fda77d0be67 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:22.365535 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bbdbb92-4b5b-4168-9dd3-3fda77d0be67 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:22.519355 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1bbdbb92-4b5b-4168-9dd3-3fda77d0be67 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:22.528046 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1bbdbb92-4b5b-4168-9dd3-3fda77d0be67 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.176028 Jul 20 11:37:22.528895 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 124/250] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:22 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:23.037834 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bc8f71da-8ae3-4813-b7cd-9de7310a533b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:23.037834 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bc8f71da-8ae3-4813-b7cd-9de7310a533b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:23.042930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bc8f71da-8ae3-4813-b7cd-9de7310a533b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:23.043374 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bc8f71da-8ae3-4813-b7cd-9de7310a533b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:23.044171 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bc8f71da-8ae3-4813-b7cd-9de7310a533b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:23.044620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bc8f71da-8ae3-4813-b7cd-9de7310a533b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:23.182383 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bc8f71da-8ae3-4813-b7cd-9de7310a533b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:23.191156 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bc8f71da-8ae3-4813-b7cd-9de7310a533b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1555 microversion: 2.1 time: 0.159249 Jul 20 11:37:23.201629 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 127/251] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:23 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:23.547056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fd884080-e3bc-4bc5-9cb9-cef38786226a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:23.547680 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fd884080-e3bc-4bc5-9cb9-cef38786226a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:23.556188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd884080-e3bc-4bc5-9cb9-cef38786226a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:23.557081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd884080-e3bc-4bc5-9cb9-cef38786226a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:23.558115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd884080-e3bc-4bc5-9cb9-cef38786226a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:23.558898 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fd884080-e3bc-4bc5-9cb9-cef38786226a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:23.750813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fd884080-e3bc-4bc5-9cb9-cef38786226a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:23.760259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fd884080-e3bc-4bc5-9cb9-cef38786226a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.217359 Jul 20 11:37:23.760852 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 125/252] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:23 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:24.213290 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b65e7653-b5cc-4897-9373-6b55e6f70867 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:24.215494 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b65e7653-b5cc-4897-9373-6b55e6f70867 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:24.224067 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b65e7653-b5cc-4897-9373-6b55e6f70867 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:24.231026 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b65e7653-b5cc-4897-9373-6b55e6f70867 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:24.231026 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b65e7653-b5cc-4897-9373-6b55e6f70867 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:24.231026 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b65e7653-b5cc-4897-9373-6b55e6f70867 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:24.413308 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b65e7653-b5cc-4897-9373-6b55e6f70867 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:24.428944 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b65e7653-b5cc-4897-9373-6b55e6f70867 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1555 microversion: 2.1 time: 0.223159 Jul 20 11:37:24.429547 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 128/253] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:24 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1555 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:24.779638 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-56921961-3937-4125-a05a-be69c573db75 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:24.781300 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-56921961-3937-4125-a05a-be69c573db75 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:24.793023 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56921961-3937-4125-a05a-be69c573db75 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:24.793692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56921961-3937-4125-a05a-be69c573db75 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:24.794264 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56921961-3937-4125-a05a-be69c573db75 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:24.799644 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56921961-3937-4125-a05a-be69c573db75 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:25.044066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-56921961-3937-4125-a05a-be69c573db75 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:25.054382 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-56921961-3937-4125-a05a-be69c573db75 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.281147 Jul 20 11:37:25.066842 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 126/254] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:24 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:25.449632 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2a14ace-7918-42eb-a547-efe234a2fdb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:25.454339 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2a14ace-7918-42eb-a547-efe234a2fdb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:25.461335 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2a14ace-7918-42eb-a547-efe234a2fdb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:25.462400 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2a14ace-7918-42eb-a547-efe234a2fdb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:25.463243 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2a14ace-7918-42eb-a547-efe234a2fdb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:25.463748 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2a14ace-7918-42eb-a547-efe234a2fdb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:25.633758 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2a14ace-7918-42eb-a547-efe234a2fdb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:25.643600 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2a14ace-7918-42eb-a547-efe234a2fdb5 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1555 microversion: 2.1 time: 0.200087 Jul 20 11:37:25.643600 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 129/255] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:25 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:26.073554 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d61f59a-c0ee-49d3-85d8-959768d84c26 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:26.074171 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d61f59a-c0ee-49d3-85d8-959768d84c26 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:26.080662 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d61f59a-c0ee-49d3-85d8-959768d84c26 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:26.081548 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d61f59a-c0ee-49d3-85d8-959768d84c26 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:26.085793 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d61f59a-c0ee-49d3-85d8-959768d84c26 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:26.086032 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d61f59a-c0ee-49d3-85d8-959768d84c26 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:26.337852 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d61f59a-c0ee-49d3-85d8-959768d84c26 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:26.355523 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d61f59a-c0ee-49d3-85d8-959768d84c26 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.283616 Jul 20 11:37:26.355523 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 127/256] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:26 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:26.660735 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f5c361dc-d975-4df9-a811-1d0f2a796059 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:26.661370 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f5c361dc-d975-4df9-a811-1d0f2a796059 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:26.677993 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5c361dc-d975-4df9-a811-1d0f2a796059 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:26.678887 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5c361dc-d975-4df9-a811-1d0f2a796059 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:26.680093 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5c361dc-d975-4df9-a811-1d0f2a796059 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:26.681517 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5c361dc-d975-4df9-a811-1d0f2a796059 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:27.190755 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f5c361dc-d975-4df9-a811-1d0f2a796059 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:27.205188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f5c361dc-d975-4df9-a811-1d0f2a796059 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1555 microversion: 2.1 time: 0.547769 Jul 20 11:37:27.207147 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 130/257] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:26 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1555 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:27.374451 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee6a0b27-f077-4142-85df-b6062fc9a705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:27.375066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ee6a0b27-f077-4142-85df-b6062fc9a705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:27.379853 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:27.397350 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee6a0b27-f077-4142-85df-b6062fc9a705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:27.403543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee6a0b27-f077-4142-85df-b6062fc9a705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:27.417648 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee6a0b27-f077-4142-85df-b6062fc9a705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:27.418457 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee6a0b27-f077-4142-85df-b6062fc9a705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:27.424232 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:27.953984 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee6a0b27-f077-4142-85df-b6062fc9a705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:27.978846 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee6a0b27-f077-4142-85df-b6062fc9a705 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.609339 Jul 20 11:37:27.981261 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 128/258] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:27 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:28.226160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-16aa83d1-7e6d-4c54-8668-bdd1ddb14fbd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:28.226812 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-16aa83d1-7e6d-4c54-8668-bdd1ddb14fbd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:28.248020 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16aa83d1-7e6d-4c54-8668-bdd1ddb14fbd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:28.248485 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16aa83d1-7e6d-4c54-8668-bdd1ddb14fbd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:28.249323 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16aa83d1-7e6d-4c54-8668-bdd1ddb14fbd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:28.249769 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16aa83d1-7e6d-4c54-8668-bdd1ddb14fbd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:28.570908 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-16aa83d1-7e6d-4c54-8668-bdd1ddb14fbd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:28.584906 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-16aa83d1-7e6d-4c54-8668-bdd1ddb14fbd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1555 microversion: 2.1 time: 0.364852 Jul 20 11:37:28.585648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 131/259] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:28 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1555 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:28.951824 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-85d53672-185f-455f-8b91-bbf0b289e1d2 req-67e3d274-3c28-4b35-b2d5-f40e463d0267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a924d70d-5553-4f03-b899-e19681c65665", "name": "network-vif-deleted", "tag": "e37711f1-e868-4bcd-9979-13231c875b65"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:28.966859 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-85d53672-185f-455f-8b91-bbf0b289e1d2 req-67e3d274-3c28-4b35-b2d5-f40e463d0267 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:28.967536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-85d53672-185f-455f-8b91-bbf0b289e1d2 req-67e3d274-3c28-4b35-b2d5-f40e463d0267 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:28.980364 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-85d53672-185f-455f-8b91-bbf0b289e1d2 req-67e3d274-3c28-4b35-b2d5-f40e463d0267 service nova] Creating event network-vif-deleted:e37711f1-e868-4bcd-9979-13231c875b65 for instance a924d70d-5553-4f03-b899-e19681c65665 on hv-cinder-82282 Jul 20 11:37:28.986489 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-85d53672-185f-455f-8b91-bbf0b289e1d2 req-67e3d274-3c28-4b35-b2d5-f40e463d0267 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038464 Jul 20 11:37:28.987850 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 129/260] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:37:28.995951 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-83dc07e6-55d9-4973-900a-fe5c688f7462 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:28.997374 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-83dc07e6-55d9-4973-900a-fe5c688f7462 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:29.008989 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83dc07e6-55d9-4973-900a-fe5c688f7462 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:29.008989 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83dc07e6-55d9-4973-900a-fe5c688f7462 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:29.008989 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83dc07e6-55d9-4973-900a-fe5c688f7462 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:29.008989 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83dc07e6-55d9-4973-900a-fe5c688f7462 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:29.247336 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-83dc07e6-55d9-4973-900a-fe5c688f7462 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:29.256696 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-83dc07e6-55d9-4973-900a-fe5c688f7462 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1523 microversion: 2.1 time: 0.264896 Jul 20 11:37:29.257435 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 132/261] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:28 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:29.603374 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-68f3672a-70d0-4252-8c31-841f925776f9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:29.604915 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-68f3672a-70d0-4252-8c31-841f925776f9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:29.612936 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68f3672a-70d0-4252-8c31-841f925776f9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:29.613566 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68f3672a-70d0-4252-8c31-841f925776f9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:29.615458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68f3672a-70d0-4252-8c31-841f925776f9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:29.616084 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68f3672a-70d0-4252-8c31-841f925776f9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:29.709771 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-68f3672a-70d0-4252-8c31-841f925776f9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:29.722821 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-68f3672a-70d0-4252-8c31-841f925776f9 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1513 microversion: 2.1 time: 0.123578 Jul 20 11:37:29.724125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 130/262] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:29 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1513 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:37:30.275766 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0e8e1d2e-84c0-47ed-a7db-6365fb1ba059 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:30.276986 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0e8e1d2e-84c0-47ed-a7db-6365fb1ba059 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:30.282508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=44 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:30.292540 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e8e1d2e-84c0-47ed-a7db-6365fb1ba059 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:30.292540 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e8e1d2e-84c0-47ed-a7db-6365fb1ba059 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:30.294006 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e8e1d2e-84c0-47ed-a7db-6365fb1ba059 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:30.294701 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e8e1d2e-84c0-47ed-a7db-6365fb1ba059 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:30.736359 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0e8e1d2e-84c0-47ed-a7db-6365fb1ba059 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:30.740079 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e01886fb-051b-4212-9a41-79eedbc40e7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:30.747772 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e01886fb-051b-4212-9a41-79eedbc40e7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:30.754095 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0e8e1d2e-84c0-47ed-a7db-6365fb1ba059 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1503 microversion: 2.1 time: 0.482563 Jul 20 11:37:30.754907 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 133/263] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:30 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1503 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:30.757239 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e01886fb-051b-4212-9a41-79eedbc40e7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:30.759406 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e01886fb-051b-4212-9a41-79eedbc40e7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:30.760394 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e01886fb-051b-4212-9a41-79eedbc40e7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:30.761137 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e01886fb-051b-4212-9a41-79eedbc40e7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:30.772824 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-17ce0f05-7384-4dc0-9c23-15c8286a58da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:30.772824 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-17ce0f05-7384-4dc0-9c23-15c8286a58da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:30.791154 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17ce0f05-7384-4dc0-9c23-15c8286a58da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:30.791617 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17ce0f05-7384-4dc0-9c23-15c8286a58da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:30.792414 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17ce0f05-7384-4dc0-9c23-15c8286a58da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:30.793060 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-17ce0f05-7384-4dc0-9c23-15c8286a58da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:30.837702 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e01886fb-051b-4212-9a41-79eedbc40e7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:30.839925 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e01886fb-051b-4212-9a41-79eedbc40e7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:30.842083 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-e01886fb-051b-4212-9a41-79eedbc40e7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lazy-loading 'fault' on Instance uuid a924d70d-5553-4f03-b899-e19681c65665 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:37:30.938298 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e01886fb-051b-4212-9a41-79eedbc40e7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e1209f5e4c4813933d7870e0a21e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768253801a774aa49d29c8176c46cafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:30.947956 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e01886fb-051b-4212-9a41-79eedbc40e7a tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 200 len: 1351 microversion: 2.1 time: 0.211711 Jul 20 11:37:30.953389 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 131/264] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:30 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 1351 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:31.234784 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-17ce0f05-7384-4dc0-9c23-15c8286a58da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:31.247074 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-17ce0f05-7384-4dc0-9c23-15c8286a58da tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1516 microversion: 2.1 time: 0.479023 Jul 20 11:37:31.247819 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 134/265] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:30 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1516 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:37:31.967790 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a2e0525-9eed-495b-b7c9-7e3cf41d305b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:31.970048 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5a2e0525-9eed-495b-b7c9-7e3cf41d305b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:31.991570 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a2e0525-9eed-495b-b7c9-7e3cf41d305b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:31.992015 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a2e0525-9eed-495b-b7c9-7e3cf41d305b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:31.997219 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a2e0525-9eed-495b-b7c9-7e3cf41d305b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:31.997819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5a2e0525-9eed-495b-b7c9-7e3cf41d305b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:32.030478 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-5a2e0525-9eed-495b-b7c9-7e3cf41d305b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] HTTP exception thrown: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a2e0525-9eed-495b-b7c9-7e3cf41d305b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Request method failure captured: Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 HTTP/1.1 Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-h-XCTVfzKb0PeHMsvqsI24fk12HHvbJ5mNb0v7saxaAKcJCXUea_iqEVKvpGlqm1Ys5dke78_Kq0OFpXo24Bx1kvcz2nDTaJVAGwHFNqZWANmVOSzurAqE8CCX51hFkSgU5MBHyu0z2wkBfvYysH89WIf3VkfaAl-BCxUWO48EBqU Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: 768253801a774aa49d29c8176c46cafb Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-DeleteServersTestJSON-2054712314 Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:37:32.113448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:37:32.114795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/768253801a774aa49d29c8176c46cafb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/768253801a774aa49d29c8176c46cafb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_768253801a774aa49d29c8176c46cafb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/768253801a774aa49d29c8176c46cafb"}]}] Jul 20 11:37:32.114795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-DeleteServersTestJSON-2054712314 Jul 20 11:37:32.114795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 768253801a774aa49d29c8176c46cafb Jul 20 11:37:32.114795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-DeleteServersTestJSON-2054712314 Jul 20 11:37:32.114795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-DeleteServersTestJSON-2054712314-project Jul 20 11:37:32.114795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:37:32.114795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:37:32.114795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 71e1209f5e4c4813933d7870e0a21e7d Jul 20 11:37:32.114795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-DeleteServersTestJSON-2054712314-project Jul 20 11:37:32.114795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:37:32.114795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:32.114795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'a924d70d-5553-4f03-b899-e19681c65665'} Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:37:32.115565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:32.117366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:37:32.121164 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5a2e0525-9eed-495b-b7c9-7e3cf41d305b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Returning 404 to user: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:37:32.125875 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5a2e0525-9eed-495b-b7c9-7e3cf41d305b tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 404 len: 111 microversion: 2.1 time: 0.163078 Jul 20 11:37:32.144187 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 132/266] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:31 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:37:32.479088 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ffd11046-6df3-4f5d-b103-c94c5fbd70bd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:32.480091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ffd11046-6df3-4f5d-b103-c94c5fbd70bd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:32.489409 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffd11046-6df3-4f5d-b103-c94c5fbd70bd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:32.489868 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffd11046-6df3-4f5d-b103-c94c5fbd70bd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:32.490655 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffd11046-6df3-4f5d-b103-c94c5fbd70bd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:32.491120 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ffd11046-6df3-4f5d-b103-c94c5fbd70bd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:32.545024 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-ffd11046-6df3-4f5d-b103-c94c5fbd70bd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] HTTP exception thrown: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ffd11046-6df3-4f5d-b103-c94c5fbd70bd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Request method failure captured: Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665/os-volume_attachments HTTP/1.1 Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-h-XCTVfzKb0PeHMsvqsI24fk12HHvbJ5mNb0v7saxaAKcJCXUea_iqEVKvpGlqm1Ys5dke78_Kq0OFpXo24Bx1kvcz2nDTaJVAGwHFNqZWANmVOSzurAqE8CCX51hFkSgU5MBHyu0z2wkBfvYysH89WIf3VkfaAl-BCxUWO48EBqU Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: 768253801a774aa49d29c8176c46cafb Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-DeleteServersTestJSON-2054712314 Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:37:32.571960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:37:32.575061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/768253801a774aa49d29c8176c46cafb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/768253801a774aa49d29c8176c46cafb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_768253801a774aa49d29c8176c46cafb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/768253801a774aa49d29c8176c46cafb"}]}] Jul 20 11:37:32.575061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-DeleteServersTestJSON-2054712314 Jul 20 11:37:32.575061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 768253801a774aa49d29c8176c46cafb Jul 20 11:37:32.575061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-DeleteServersTestJSON-2054712314 Jul 20 11:37:32.575061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-DeleteServersTestJSON-2054712314-project Jul 20 11:37:32.575061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:37:32.575061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:37:32.575061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 71e1209f5e4c4813933d7870e0a21e7d Jul 20 11:37:32.575061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-DeleteServersTestJSON-2054712314-project Jul 20 11:37:32.575061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:37:32.575061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:32.575061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'server_id': 'a924d70d-5553-4f03-b899-e19681c65665'} Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:37:32.575730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:32.576829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:32.577907 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ffd11046-6df3-4f5d-b103-c94c5fbd70bd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Returning 404 to user: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:37:32.590610 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ffd11046-6df3-4f5d-b103-c94c5fbd70bd tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.119030 Jul 20 11:37:32.590610 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 135/267] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:37:32 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665/os-volume_attachments => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:37:33.603672 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1018197792", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:33.730979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] validate_networks() for None {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:37:34.223457 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:37:34.223866 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:37:34.224961 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:37:34.225536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:37:34.226100 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:37:34.236186 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:34.238429 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:34.238429 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:34.238429 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:34.260554 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Getting quotas for project c5547e6a8728407bae158f8824dc6243. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:37:34.266744 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Getting quotas for user befcda2838d94fcd93e37a5b40e27c52 and project c5547e6a8728407bae158f8824dc6243. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:37:34.313712 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:37:34.316616 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:37:34.609181 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2422a78a-872e-4ceb-9772-0f8cd6088f40 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009243 Jul 20 11:37:34.623533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 133/268] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:37:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:37:34.629340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-81870c2a-fa9b-4421-8660-1f021be9ad07 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:34.632394 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-81870c2a-fa9b-4421-8660-1f021be9ad07 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:34.714823 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-81870c2a-fa9b-4421-8660-1f021be9ad07 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:34.728875 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-81870c2a-fa9b-4421-8660-1f021be9ad07 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1215 microversion: 2.1 time: 0.104045 Jul 20 11:37:34.738421 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 136/269] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:34 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:34.851167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4b35c956-7102-41b2-94d8-6a279b3f334e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:34.851167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4b35c956-7102-41b2-94d8-6a279b3f334e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:34.855956 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b35c956-7102-41b2-94d8-6a279b3f334e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:34.856483 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b35c956-7102-41b2-94d8-6a279b3f334e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:34.857464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b35c956-7102-41b2-94d8-6a279b3f334e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:34.858532 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b35c956-7102-41b2-94d8-6a279b3f334e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:35.138546 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-4b35c956-7102-41b2-94d8-6a279b3f334e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lazy-loading 'flavor' on Instance uuid 67c74b02-2e59-452e-9d39-949b9325a4e4 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:37:35.239874 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f6192989-e9a2-4bdc-b725-fe0bca4eb148 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:35.240368 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f6192989-e9a2-4bdc-b725-fe0bca4eb148 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:35.248035 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6192989-e9a2-4bdc-b725-fe0bca4eb148 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:35.248513 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6192989-e9a2-4bdc-b725-fe0bca4eb148 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:35.249564 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6192989-e9a2-4bdc-b725-fe0bca4eb148 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:35.249973 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6192989-e9a2-4bdc-b725-fe0bca4eb148 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:35.268541 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-f6192989-e9a2-4bdc-b725-fe0bca4eb148 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] HTTP exception thrown: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f6192989-e9a2-4bdc-b725-fe0bca4eb148 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Request method failure captured: Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 HTTP/1.1 Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-h-XCTVfzKb0PeHMsvqsI24fk12HHvbJ5mNb0v7saxaAKcJCXUea_iqEVKvpGlqm1Ys5dke78_Kq0OFpXo24Bx1kvcz2nDTaJVAGwHFNqZWANmVOSzurAqE8CCX51hFkSgU5MBHyu0z2wkBfvYysH89WIf3VkfaAl-BCxUWO48EBqU Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: 768253801a774aa49d29c8176c46cafb Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-DeleteServersTestJSON-2054712314 Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:37:35.271197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:37:35.272453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/768253801a774aa49d29c8176c46cafb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/768253801a774aa49d29c8176c46cafb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_768253801a774aa49d29c8176c46cafb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/768253801a774aa49d29c8176c46cafb"}]}] Jul 20 11:37:35.272453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-DeleteServersTestJSON-2054712314 Jul 20 11:37:35.272453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 768253801a774aa49d29c8176c46cafb Jul 20 11:37:35.272453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-DeleteServersTestJSON-2054712314 Jul 20 11:37:35.272453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-DeleteServersTestJSON-2054712314-project Jul 20 11:37:35.272453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:37:35.272453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:37:35.272453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 71e1209f5e4c4813933d7870e0a21e7d Jul 20 11:37:35.272453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-DeleteServersTestJSON-2054712314-project Jul 20 11:37:35.272453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:37:35.272453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:35.272453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'a924d70d-5553-4f03-b899-e19681c65665'} Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:37:35.273166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:35.274298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:35.277390 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f6192989-e9a2-4bdc-b725-fe0bca4eb148 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Returning 404 to user: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:37:35.278799 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f6192989-e9a2-4bdc-b725-fe0bca4eb148 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 404 len: 111 microversion: 2.1 time: 0.044628 Jul 20 11:37:35.279886 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 137/270] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:37:35 2022] DELETE /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:37:35.297044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-683a329a-0092-4d91-b0fd-91f1406a7f79 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:35.299816 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-683a329a-0092-4d91-b0fd-91f1406a7f79 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] [instance: a924d70d-5553-4f03-b899-e19681c65665] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:35.321825 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-683a329a-0092-4d91-b0fd-91f1406a7f79 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:35.324582 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-683a329a-0092-4d91-b0fd-91f1406a7f79 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:35.325646 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-683a329a-0092-4d91-b0fd-91f1406a7f79 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:35.327464 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-683a329a-0092-4d91-b0fd-91f1406a7f79 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:35.396329 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-683a329a-0092-4d91-b0fd-91f1406a7f79 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] HTTP exception thrown: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-683a329a-0092-4d91-b0fd-91f1406a7f79 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Request method failure captured: Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 HTTP/1.1 Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-h-XCTVfzKb0PeHMsvqsI24fk12HHvbJ5mNb0v7saxaAKcJCXUea_iqEVKvpGlqm1Ys5dke78_Kq0OFpXo24Bx1kvcz2nDTaJVAGwHFNqZWANmVOSzurAqE8CCX51hFkSgU5MBHyu0z2wkBfvYysH89WIf3VkfaAl-BCxUWO48EBqU Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: 768253801a774aa49d29c8176c46cafb Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-DeleteServersTestJSON-2054712314 Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:37:35.398116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:37:35.399851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/768253801a774aa49d29c8176c46cafb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/768253801a774aa49d29c8176c46cafb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_768253801a774aa49d29c8176c46cafb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/768253801a774aa49d29c8176c46cafb"}]}] Jul 20 11:37:35.399851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-DeleteServersTestJSON-2054712314 Jul 20 11:37:35.399851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 768253801a774aa49d29c8176c46cafb Jul 20 11:37:35.399851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-DeleteServersTestJSON-2054712314 Jul 20 11:37:35.399851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-DeleteServersTestJSON-2054712314-project Jul 20 11:37:35.399851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:37:35.399851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:37:35.399851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 71e1209f5e4c4813933d7870e0a21e7d Jul 20 11:37:35.399851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-DeleteServersTestJSON-2054712314-project Jul 20 11:37:35.399851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:37:35.399851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:35.399851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'a924d70d-5553-4f03-b899-e19681c65665'} Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:37:35.400526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. Jul 20 11:37:35.402296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:37:35.406414 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-683a329a-0092-4d91-b0fd-91f1406a7f79 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] Returning 404 to user: Instance a924d70d-5553-4f03-b899-e19681c65665 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:37:35.407510 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-683a329a-0092-4d91-b0fd-91f1406a7f79 tempest-DeleteServersTestJSON-2054712314 tempest-DeleteServersTestJSON-2054712314-project] 10.222.0.43 "GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665" status: 404 len: 111 microversion: 2.1 time: 0.123868 Jul 20 11:37:35.408281 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 138/271] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:35 2022] GET /compute/v2.1/servers/a924d70d-5553-4f03-b899-e19681c65665 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:37:35.564131 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4b35c956-7102-41b2-94d8-6a279b3f334e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "POST /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4/action" status: 200 len: 32 microversion: 2.1 time: 0.724568 Jul 20 11:37:35.566167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 134/272] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:37:34 2022] POST /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4/action => generated 32 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:37:35.575561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-293fc291-679f-42a8-954f-a03e4c951310 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:35.576216 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-293fc291-679f-42a8-954f-a03e4c951310 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:35.596397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-293fc291-679f-42a8-954f-a03e4c951310 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:35.597287 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-293fc291-679f-42a8-954f-a03e4c951310 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:35.598992 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-293fc291-679f-42a8-954f-a03e4c951310 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:35.599773 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-293fc291-679f-42a8-954f-a03e4c951310 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:35.746890 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b5190ed7-6028-4959-8180-80d58ce221c4 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:35.747600 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b5190ed7-6028-4959-8180-80d58ce221c4 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:35.951612 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b5190ed7-6028-4959-8180-80d58ce221c4 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:35.960239 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b5190ed7-6028-4959-8180-80d58ce221c4 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1215 microversion: 2.1 time: 0.217747 Jul 20 11:37:35.960882 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 135/273] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:35 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:36.192582 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-293fc291-679f-42a8-954f-a03e4c951310 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:36.204245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-293fc291-679f-42a8-954f-a03e4c951310 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.633138 Jul 20 11:37:36.238755 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 139/274] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:35 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:36.978926 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7dfd14b5-8cfe-4362-8f8f-d6a7ca0e7d1e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:36.979544 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7dfd14b5-8cfe-4362-8f8f-d6a7ca0e7d1e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:36.986418 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7dfd14b5-8cfe-4362-8f8f-d6a7ca0e7d1e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:36.986864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7dfd14b5-8cfe-4362-8f8f-d6a7ca0e7d1e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:36.988202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7dfd14b5-8cfe-4362-8f8f-d6a7ca0e7d1e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:36.988202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7dfd14b5-8cfe-4362-8f8f-d6a7ca0e7d1e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:37.064199 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7dfd14b5-8cfe-4362-8f8f-d6a7ca0e7d1e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:37.073368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7dfd14b5-8cfe-4362-8f8f-d6a7ca0e7d1e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1219 microversion: 2.1 time: 0.098797 Jul 20 11:37:37.074052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 136/275] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:36 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:37.231570 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e9c3caa1-4efe-4bd4-bd51-f9d36f1c1a5c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:37.234847 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e9c3caa1-4efe-4bd4-bd51-f9d36f1c1a5c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:37.242265 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9c3caa1-4efe-4bd4-bd51-f9d36f1c1a5c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:37.243244 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9c3caa1-4efe-4bd4-bd51-f9d36f1c1a5c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:37.244256 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9c3caa1-4efe-4bd4-bd51-f9d36f1c1a5c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:37.244920 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e9c3caa1-4efe-4bd4-bd51-f9d36f1c1a5c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:37.457494 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e9c3caa1-4efe-4bd4-bd51-f9d36f1c1a5c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:37.466732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e9c3caa1-4efe-4bd4-bd51-f9d36f1c1a5c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.241288 Jul 20 11:37:37.477768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 140/276] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:37 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:38.095951 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-79937835-58ab-4591-b31e-c2deb3f83342 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:38.097225 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-79937835-58ab-4591-b31e-c2deb3f83342 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:38.105233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79937835-58ab-4591-b31e-c2deb3f83342 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:38.108068 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79937835-58ab-4591-b31e-c2deb3f83342 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:38.109179 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79937835-58ab-4591-b31e-c2deb3f83342 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:38.112896 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79937835-58ab-4591-b31e-c2deb3f83342 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:38.347751 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-79937835-58ab-4591-b31e-c2deb3f83342 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:38.358341 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-79937835-58ab-4591-b31e-c2deb3f83342 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1267 microversion: 2.1 time: 0.266462 Jul 20 11:37:38.361672 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 137/277] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:38 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:38.486362 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-66a71748-d61a-4003-b79e-5eaf8c13d8cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:38.487024 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-66a71748-d61a-4003-b79e-5eaf8c13d8cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:38.511623 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66a71748-d61a-4003-b79e-5eaf8c13d8cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:38.516142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66a71748-d61a-4003-b79e-5eaf8c13d8cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:38.517457 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66a71748-d61a-4003-b79e-5eaf8c13d8cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:38.518089 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-66a71748-d61a-4003-b79e-5eaf8c13d8cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:39.135050 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-66a71748-d61a-4003-b79e-5eaf8c13d8cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:39.145305 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-66a71748-d61a-4003-b79e-5eaf8c13d8cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.663828 Jul 20 11:37:39.146158 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 141/278] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:38 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:39.380557 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-df98bba6-4823-4642-8488-0941805de595 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:39.381770 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-df98bba6-4823-4642-8488-0941805de595 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:39.393977 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df98bba6-4823-4642-8488-0941805de595 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:39.398054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df98bba6-4823-4642-8488-0941805de595 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:39.398054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df98bba6-4823-4642-8488-0941805de595 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:39.398054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df98bba6-4823-4642-8488-0941805de595 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:39.484126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-df98bba6-4823-4642-8488-0941805de595 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:39.492208 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-df98bba6-4823-4642-8488-0941805de595 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1273 microversion: 2.1 time: 0.115394 Jul 20 11:37:39.497969 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 138/279] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:39 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:40.162831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b499751d-6f69-4f1e-af90-96903f9c5810 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:40.163559 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b499751d-6f69-4f1e-af90-96903f9c5810 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:40.171122 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b499751d-6f69-4f1e-af90-96903f9c5810 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:40.171969 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b499751d-6f69-4f1e-af90-96903f9c5810 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:40.172946 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b499751d-6f69-4f1e-af90-96903f9c5810 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:40.173526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b499751d-6f69-4f1e-af90-96903f9c5810 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:40.520242 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-292cc5c5-6bca-4be2-ad10-d87d0804e37c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:40.526945 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-292cc5c5-6bca-4be2-ad10-d87d0804e37c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:40.540529 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-292cc5c5-6bca-4be2-ad10-d87d0804e37c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:40.541005 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-292cc5c5-6bca-4be2-ad10-d87d0804e37c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:40.541918 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-292cc5c5-6bca-4be2-ad10-d87d0804e37c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:40.542675 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-292cc5c5-6bca-4be2-ad10-d87d0804e37c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:40.594993 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b499751d-6f69-4f1e-af90-96903f9c5810 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:40.604367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b499751d-6f69-4f1e-af90-96903f9c5810 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.445279 Jul 20 11:37:40.609830 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 142/280] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:40 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:40.745414 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-292cc5c5-6bca-4be2-ad10-d87d0804e37c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:40.754820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-292cc5c5-6bca-4be2-ad10-d87d0804e37c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1273 microversion: 2.1 time: 0.245095 Jul 20 11:37:40.765798 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 139/281] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:40 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:37:41.627284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-44191b5b-ab92-407e-bcb3-319d81851a23 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:41.627971 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-44191b5b-ab92-407e-bcb3-319d81851a23 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:41.647402 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44191b5b-ab92-407e-bcb3-319d81851a23 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:41.649089 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44191b5b-ab92-407e-bcb3-319d81851a23 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:41.658741 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44191b5b-ab92-407e-bcb3-319d81851a23 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:41.659497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44191b5b-ab92-407e-bcb3-319d81851a23 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:41.675925 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:41.773782 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0b0b4256-3b02-4c86-8de3-4f5c7b5ce13b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:41.774523 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0b0b4256-3b02-4c86-8de3-4f5c7b5ce13b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:41.782754 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0b4256-3b02-4c86-8de3-4f5c7b5ce13b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:41.783243 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0b4256-3b02-4c86-8de3-4f5c7b5ce13b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:41.784099 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0b4256-3b02-4c86-8de3-4f5c7b5ce13b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:41.784532 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b0b4256-3b02-4c86-8de3-4f5c7b5ce13b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:42.455687 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-44191b5b-ab92-407e-bcb3-319d81851a23 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:42.463910 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-44191b5b-ab92-407e-bcb3-319d81851a23 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.841220 Jul 20 11:37:42.473844 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 143/282] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:41 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:42.493101 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0b0b4256-3b02-4c86-8de3-4f5c7b5ce13b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:42.501470 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0b0b4256-3b02-4c86-8de3-4f5c7b5ce13b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1315 microversion: 2.1 time: 0.732736 Jul 20 11:37:42.502209 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 140/283] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:41 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1315 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:43.487974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-35ae8f3e-bb8e-48f2-b8e4-a173532efa18 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:43.488590 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-35ae8f3e-bb8e-48f2-b8e4-a173532efa18 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:43.497503 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35ae8f3e-bb8e-48f2-b8e4-a173532efa18 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:43.501056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35ae8f3e-bb8e-48f2-b8e4-a173532efa18 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:43.501056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35ae8f3e-bb8e-48f2-b8e4-a173532efa18 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:43.501056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35ae8f3e-bb8e-48f2-b8e4-a173532efa18 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:43.526697 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6ecd6966-b41e-4e75-8a58-78a8f5d94faf tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:43.527844 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6ecd6966-b41e-4e75-8a58-78a8f5d94faf tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:43.541425 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ecd6966-b41e-4e75-8a58-78a8f5d94faf tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:43.541878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ecd6966-b41e-4e75-8a58-78a8f5d94faf tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:43.542668 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ecd6966-b41e-4e75-8a58-78a8f5d94faf tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:43.543107 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ecd6966-b41e-4e75-8a58-78a8f5d94faf tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:44.095235 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-35ae8f3e-bb8e-48f2-b8e4-a173532efa18 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:44.103090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6ecd6966-b41e-4e75-8a58-78a8f5d94faf tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:44.108341 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-35ae8f3e-bb8e-48f2-b8e4-a173532efa18 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.631168 Jul 20 11:37:44.111625 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 144/284] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:43 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:44.112177 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6ecd6966-b41e-4e75-8a58-78a8f5d94faf tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1315 microversion: 2.1 time: 0.589862 Jul 20 11:37:44.113070 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 141/285] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:43 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:44.126909 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-0da74ceb-321f-49dc-9500-4abb6208ca26 req-7be4d0fd-3595-47d8-bc25-ae96a8ff538e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77041ff-ede6-4648-99ee-5f97909cbd34", "tag": "572c845f-f47f-4120-932d-de63220a9c87"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:44.148628 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-0da74ceb-321f-49dc-9500-4abb6208ca26 req-7be4d0fd-3595-47d8-bc25-ae96a8ff538e service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:44.150046 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-0da74ceb-321f-49dc-9500-4abb6208ca26 req-7be4d0fd-3595-47d8-bc25-ae96a8ff538e service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:44.162606 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-0da74ceb-321f-49dc-9500-4abb6208ca26 req-7be4d0fd-3595-47d8-bc25-ae96a8ff538e service nova] Creating event network-changed:572c845f-f47f-4120-932d-de63220a9c87 for instance a77041ff-ede6-4648-99ee-5f97909cbd34 on hv-cinder-82282 Jul 20 11:37:44.167575 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-0da74ceb-321f-49dc-9500-4abb6208ca26 req-7be4d0fd-3595-47d8-bc25-ae96a8ff538e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054456 Jul 20 11:37:44.168169 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 145/286] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:37:45.127362 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-37aef117-3def-484f-a27d-b26d3f7298cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:45.127954 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-37aef117-3def-484f-a27d-b26d3f7298cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:45.131442 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:45.139746 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-77c9de61-ed8c-4622-b8b5-6326f5e80c51 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:45.140479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-77c9de61-ed8c-4622-b8b5-6326f5e80c51 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:45.150746 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:45.166320 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37aef117-3def-484f-a27d-b26d3f7298cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:45.166775 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37aef117-3def-484f-a27d-b26d3f7298cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:45.172835 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77c9de61-ed8c-4622-b8b5-6326f5e80c51 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:45.174604 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77c9de61-ed8c-4622-b8b5-6326f5e80c51 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:45.177510 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37aef117-3def-484f-a27d-b26d3f7298cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:45.178334 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37aef117-3def-484f-a27d-b26d3f7298cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:45.179324 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77c9de61-ed8c-4622-b8b5-6326f5e80c51 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:45.184671 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77c9de61-ed8c-4622-b8b5-6326f5e80c51 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:45.490455 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-77c9de61-ed8c-4622-b8b5-6326f5e80c51 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:45.495133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37aef117-3def-484f-a27d-b26d3f7298cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:45.512028 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-37aef117-3def-484f-a27d-b26d3f7298cf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.388402 Jul 20 11:37:45.512606 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 142/287] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:45 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:45.515291 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-77c9de61-ed8c-4622-b8b5-6326f5e80c51 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1315 microversion: 2.1 time: 0.385109 Jul 20 11:37:45.516805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 146/288] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:45 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:46.542677 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-12d32589-0a82-4e0b-b3b4-77ed10ac6f6c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:46.545552 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-12d32589-0a82-4e0b-b3b4-77ed10ac6f6c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:46.550053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5ab66f5b-082f-4f26-b425-af121206b84f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:46.551511 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5ab66f5b-082f-4f26-b425-af121206b84f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:46.553386 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=8 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:46.555914 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12d32589-0a82-4e0b-b3b4-77ed10ac6f6c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:46.556489 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12d32589-0a82-4e0b-b3b4-77ed10ac6f6c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:46.557412 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12d32589-0a82-4e0b-b3b4-77ed10ac6f6c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:46.558117 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-12d32589-0a82-4e0b-b3b4-77ed10ac6f6c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:46.560226 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ab66f5b-082f-4f26-b425-af121206b84f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:46.560936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ab66f5b-082f-4f26-b425-af121206b84f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:46.562154 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ab66f5b-082f-4f26-b425-af121206b84f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:46.562756 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ab66f5b-082f-4f26-b425-af121206b84f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:46.839244 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5ab66f5b-082f-4f26-b425-af121206b84f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:46.848107 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5ab66f5b-082f-4f26-b425-af121206b84f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.306902 Jul 20 11:37:46.848731 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 147/289] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:46 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:46.871379 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-12d32589-0a82-4e0b-b3b4-77ed10ac6f6c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:46.879064 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-12d32589-0a82-4e0b-b3b4-77ed10ac6f6c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1315 microversion: 2.1 time: 0.341423 Jul 20 11:37:46.879617 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 143/290] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:46 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:47.865078 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6cc5269d-e79e-4eb2-9d54-2bee2d3ddcbe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:47.865814 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6cc5269d-e79e-4eb2-9d54-2bee2d3ddcbe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:47.875248 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cc5269d-e79e-4eb2-9d54-2bee2d3ddcbe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:47.876278 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cc5269d-e79e-4eb2-9d54-2bee2d3ddcbe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:47.877115 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cc5269d-e79e-4eb2-9d54-2bee2d3ddcbe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:47.877553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6cc5269d-e79e-4eb2-9d54-2bee2d3ddcbe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:47.896615 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4b13123e-950f-4fd5-8ced-80cf4c2d4f0c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:47.897371 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4b13123e-950f-4fd5-8ced-80cf4c2d4f0c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:47.904040 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b13123e-950f-4fd5-8ced-80cf4c2d4f0c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:47.904478 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b13123e-950f-4fd5-8ced-80cf4c2d4f0c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:47.905266 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b13123e-950f-4fd5-8ced-80cf4c2d4f0c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:47.905699 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4b13123e-950f-4fd5-8ced-80cf4c2d4f0c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:48.145507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4b13123e-950f-4fd5-8ced-80cf4c2d4f0c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:48.154472 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6cc5269d-e79e-4eb2-9d54-2bee2d3ddcbe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:48.154662 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4b13123e-950f-4fd5-8ced-80cf4c2d4f0c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1315 microversion: 2.1 time: 0.262064 Jul 20 11:37:48.155133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 144/291] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:47 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:37:48.166241 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6cc5269d-e79e-4eb2-9d54-2bee2d3ddcbe tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.303259 Jul 20 11:37:48.166241 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 148/292] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:47 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:48.247008 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97b21b8c-6a8f-4f82-99cc-2b60ebf2be16 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Action: 'create', calling method: .version_select at 0x7f44e0391d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1342398398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIghJX/s+Tm098msH+ves3UyeJ7H1U/WzbtNP+zjnz0r/UYwLAhk4QfJVoThExgU1sSmOPN44A5wsxAk+3sEczvXrBGzCpV42pRTK/BMoq1jzzPyC22LF6eN39UhBeUV6w=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:48.263449 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-97b21b8c-6a8f-4f82-99cc-2b60ebf2be16 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Getting quotas for project afc92f5b75ea4f78869086626d7c2b4c. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:37:48.268023 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-97b21b8c-6a8f-4f82-99cc-2b60ebf2be16 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Getting quotas for user 0db227f5aa914cc7b0ab04ae3666fadb and project afc92f5b75ea4f78869086626d7c2b4c. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:37:48.362058 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97b21b8c-6a8f-4f82-99cc-2b60ebf2be16 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.119166 Jul 20 11:37:48.362685 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 145/293] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 11:37:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:37:48.480669 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-524696886", "imageRef": "f4c34ef3-9ee8-43c6-adbe-2328546122c4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1342398398", "networks": [{"uuid": "c01204b3-2c06-4983-b25b-4591a14396b5"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:48.539419 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] validate_networks() for [('c01204b3-2c06-4983-b25b-4591a14396b5', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:37:49.178245 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-467dede0-18f2-49c3-bb2d-c89d89e4a2ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:49.178245 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-467dede0-18f2-49c3-bb2d-c89d89e4a2ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:49.181519 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-467dede0-18f2-49c3-bb2d-c89d89e4a2ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:49.181670 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-467dede0-18f2-49c3-bb2d-c89d89e4a2ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:49.182596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-467dede0-18f2-49c3-bb2d-c89d89e4a2ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:49.183039 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-467dede0-18f2-49c3-bb2d-c89d89e4a2ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:49.201871 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:49.619377 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:37:49.619862 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:37:49.620500 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:37:49.621161 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:37:49.621725 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:37:49.632580 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:49.633182 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:49.633923 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:49.634653 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:49.653719 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Getting quotas for project afc92f5b75ea4f78869086626d7c2b4c. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:37:49.658666 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Getting quotas for user 0db227f5aa914cc7b0ab04ae3666fadb and project afc92f5b75ea4f78869086626d7c2b4c. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:37:49.671509 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:37:49.674152 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4c34ef3-9ee8-43c6-adbe-2328546122c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:37:49.698132 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-467dede0-18f2-49c3-bb2d-c89d89e4a2ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:49.710197 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-467dede0-18f2-49c3-bb2d-c89d89e4a2ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1315 microversion: 2.1 time: 0.541911 Jul 20 11:37:49.710860 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 146/294] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:49 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:37:49.719889 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f26e25fd-57d5-487d-b931-d954abb6e7bf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:49.720553 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f26e25fd-57d5-487d-b931-d954abb6e7bf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:49.728014 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f26e25fd-57d5-487d-b931-d954abb6e7bf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:49.728476 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f26e25fd-57d5-487d-b931-d954abb6e7bf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:49.729263 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f26e25fd-57d5-487d-b931-d954abb6e7bf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:49.729863 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f26e25fd-57d5-487d-b931-d954abb6e7bf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:49.794597 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c3aab01b-4945-411e-9aa8-3f85341737bb tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.317849 Jul 20 11:37:49.795934 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 149/295] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:37:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:37:49.808028 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba1f027f-b52c-4adb-996a-1eae6d9714b9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:49.808643 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ba1f027f-b52c-4adb-996a-1eae6d9714b9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:49.921399 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba1f027f-b52c-4adb-996a-1eae6d9714b9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:49.940491 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba1f027f-b52c-4adb-996a-1eae6d9714b9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1258 microversion: 2.1 time: 0.127615 Jul 20 11:37:49.940491 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 150/296] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:49 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1258 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:50.005685 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f26e25fd-57d5-487d-b931-d954abb6e7bf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:50.015616 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f26e25fd-57d5-487d-b931-d954abb6e7bf tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.298817 Jul 20 11:37:50.015616 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 147/297] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:49 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:50.728130 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-43c08cf8-ae13-40b0-a80c-c7eba70385c8 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:50.729089 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-43c08cf8-ae13-40b0-a80c-c7eba70385c8 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:50.735498 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43c08cf8-ae13-40b0-a80c-c7eba70385c8 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:50.736036 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43c08cf8-ae13-40b0-a80c-c7eba70385c8 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:50.736820 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43c08cf8-ae13-40b0-a80c-c7eba70385c8 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:50.737431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43c08cf8-ae13-40b0-a80c-c7eba70385c8 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:50.895870 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-43c08cf8-ae13-40b0-a80c-c7eba70385c8 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:50.904521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-43c08cf8-ae13-40b0-a80c-c7eba70385c8 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1315 microversion: 2.1 time: 0.180808 Jul 20 11:37:50.906674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 151/298] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:50 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:50.950882 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-069618da-ec4d-4b95-97ae-a1273c1ad265 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:50.951494 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-069618da-ec4d-4b95-97ae-a1273c1ad265 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:51.025232 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-069618da-ec4d-4b95-97ae-a1273c1ad265 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:51.034645 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-069618da-ec4d-4b95-97ae-a1273c1ad265 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1258 microversion: 2.1 time: 0.087489 Jul 20 11:37:51.039573 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-211d4222-6855-4765-b674-b70cd45034f0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:51.041817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-211d4222-6855-4765-b674-b70cd45034f0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:51.046141 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 148/299] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:50 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1258 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:51.050071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-211d4222-6855-4765-b674-b70cd45034f0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:51.050501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-211d4222-6855-4765-b674-b70cd45034f0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:51.051454 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-211d4222-6855-4765-b674-b70cd45034f0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:51.051890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-211d4222-6855-4765-b674-b70cd45034f0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:51.265917 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-211d4222-6855-4765-b674-b70cd45034f0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:51.274245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-211d4222-6855-4765-b674-b70cd45034f0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.246558 Jul 20 11:37:51.275383 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 152/300] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:51 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:51.921682 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ca89e545-2be6-4ff7-93e8-d2fb29511fa7 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:51.922495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ca89e545-2be6-4ff7-93e8-d2fb29511fa7 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:51.930384 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca89e545-2be6-4ff7-93e8-d2fb29511fa7 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:51.931519 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca89e545-2be6-4ff7-93e8-d2fb29511fa7 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:51.932310 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca89e545-2be6-4ff7-93e8-d2fb29511fa7 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:51.932750 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ca89e545-2be6-4ff7-93e8-d2fb29511fa7 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:52.051419 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2b417a70-c598-4519-9fb6-7a225c1a2b36 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:52.052010 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2b417a70-c598-4519-9fb6-7a225c1a2b36 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:52.064393 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b417a70-c598-4519-9fb6-7a225c1a2b36 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:52.064905 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b417a70-c598-4519-9fb6-7a225c1a2b36 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:52.072523 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b417a70-c598-4519-9fb6-7a225c1a2b36 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:52.073019 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b417a70-c598-4519-9fb6-7a225c1a2b36 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:52.170193 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2b417a70-c598-4519-9fb6-7a225c1a2b36 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:52.179023 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ca89e545-2be6-4ff7-93e8-d2fb29511fa7 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:52.191808 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ca89e545-2be6-4ff7-93e8-d2fb29511fa7 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1315 microversion: 2.1 time: 0.270566 Jul 20 11:37:52.194488 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2b417a70-c598-4519-9fb6-7a225c1a2b36 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1254 microversion: 2.1 time: 0.146358 Jul 20 11:37:52.202873 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 149/301] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:51 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:52.205863 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 153/302] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:52 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1254 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:52.295098 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b8ee6fac-b5d4-43c9-b61f-9e9ed0afa0a2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:52.295849 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b8ee6fac-b5d4-43c9-b61f-9e9ed0afa0a2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:52.304517 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8ee6fac-b5d4-43c9-b61f-9e9ed0afa0a2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:52.305313 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8ee6fac-b5d4-43c9-b61f-9e9ed0afa0a2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:52.307380 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8ee6fac-b5d4-43c9-b61f-9e9ed0afa0a2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:52.308813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b8ee6fac-b5d4-43c9-b61f-9e9ed0afa0a2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:52.641350 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b8ee6fac-b5d4-43c9-b61f-9e9ed0afa0a2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:52.652727 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b8ee6fac-b5d4-43c9-b61f-9e9ed0afa0a2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.364781 Jul 20 11:37:52.654648 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 150/303] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:52 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:53.217130 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2eb49491-4a19-4784-b6ce-6099cf7fedb5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:53.217130 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2eb49491-4a19-4784-b6ce-6099cf7fedb5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:53.217832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4445ede6-8f61-434d-b995-f599a06a9fc3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:53.219053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4445ede6-8f61-434d-b995-f599a06a9fc3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:53.239746 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4445ede6-8f61-434d-b995-f599a06a9fc3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:53.240616 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4445ede6-8f61-434d-b995-f599a06a9fc3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:53.246116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2eb49491-4a19-4784-b6ce-6099cf7fedb5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:53.246262 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4445ede6-8f61-434d-b995-f599a06a9fc3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:53.246262 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4445ede6-8f61-434d-b995-f599a06a9fc3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:53.248319 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2eb49491-4a19-4784-b6ce-6099cf7fedb5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:53.249602 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2eb49491-4a19-4784-b6ce-6099cf7fedb5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:53.250060 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2eb49491-4a19-4784-b6ce-6099cf7fedb5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:53.491361 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4445ede6-8f61-434d-b995-f599a06a9fc3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:53.517213 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4445ede6-8f61-434d-b995-f599a06a9fc3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1254 microversion: 2.1 time: 0.300917 Jul 20 11:37:53.520890 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 151/304] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:53 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1254 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:53.672165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-050c2f88-98e1-4ec9-9851-98786a1a2b29 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:53.672809 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-050c2f88-98e1-4ec9-9851-98786a1a2b29 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:53.684822 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-050c2f88-98e1-4ec9-9851-98786a1a2b29 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:53.685287 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-050c2f88-98e1-4ec9-9851-98786a1a2b29 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:53.690177 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-050c2f88-98e1-4ec9-9851-98786a1a2b29 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:53.690729 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-050c2f88-98e1-4ec9-9851-98786a1a2b29 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:54.106293 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2eb49491-4a19-4784-b6ce-6099cf7fedb5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:54.116813 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2eb49491-4a19-4784-b6ce-6099cf7fedb5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1315 microversion: 2.1 time: 0.910924 Jul 20 11:37:54.135882 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 154/305] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:53 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1315 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:54.194112 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-050c2f88-98e1-4ec9-9851-98786a1a2b29 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:54.206956 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-050c2f88-98e1-4ec9-9851-98786a1a2b29 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.539491 Jul 20 11:37:54.208081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 152/306] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:53 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:54.507924 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e757648c-a177-42be-8f28-21cc2c514d97 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Action: 'create', calling method: .version_select at 0x7f44e022e310>, body: {"keypair": {"name": "tempest-keypair-1628550765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOJRMArwYvnMiNDts0es7LYmMUd8MR2wX51pkvkpv6pTqjnCbWhBoAr8UmIe0Azj4v+y33uNRqkMfGqe8ABrnNp8lG3YugEe/EKP4HOhE09dafW0S2DE+OEbdkCdUZaWA=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:54.528376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-e757648c-a177-42be-8f28-21cc2c514d97 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Getting quotas for project a18ce8b9ff3945ebbbf933d072515d53. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:37:54.532710 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-e757648c-a177-42be-8f28-21cc2c514d97 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Getting quotas for user 63bd59ed8f4e4ae28253a9884b727c98 and project a18ce8b9ff3945ebbbf933d072515d53. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:37:54.542273 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5d61c9b2-b1d8-40c9-b521-36fc44506396 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:54.542896 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5d61c9b2-b1d8-40c9-b521-36fc44506396 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:54.549539 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d61c9b2-b1d8-40c9-b521-36fc44506396 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:54.550084 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d61c9b2-b1d8-40c9-b521-36fc44506396 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:54.551213 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d61c9b2-b1d8-40c9-b521-36fc44506396 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:54.552022 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d61c9b2-b1d8-40c9-b521-36fc44506396 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:54.667823 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5d61c9b2-b1d8-40c9-b521-36fc44506396 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:54.691360 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5d61c9b2-b1d8-40c9-b521-36fc44506396 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1318 microversion: 2.1 time: 0.143410 Jul 20 11:37:54.691819 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e757648c-a177-42be-8f28-21cc2c514d97 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.299025 Jul 20 11:37:54.694647 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 155/308] 10.222.0.43 () {62 vars in 1199 bytes} [Wed Jul 20 11:37:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 313 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 11:37:54.702970 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 153/308] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:54 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:55.136259 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4237835a-96ef-4214-880d-fa340428b16b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:55.138282 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4237835a-96ef-4214-880d-fa340428b16b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:55.158669 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4237835a-96ef-4214-880d-fa340428b16b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:55.159141 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4237835a-96ef-4214-880d-fa340428b16b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:55.159947 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4237835a-96ef-4214-880d-fa340428b16b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:55.160390 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4237835a-96ef-4214-880d-fa340428b16b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:55.229205 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0c1719c4-bd36-49bb-857d-1a26b3e9c546 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:55.230165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0c1719c4-bd36-49bb-857d-1a26b3e9c546 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:55.238401 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c1719c4-bd36-49bb-857d-1a26b3e9c546 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:55.239084 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c1719c4-bd36-49bb-857d-1a26b3e9c546 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:55.240118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c1719c4-bd36-49bb-857d-1a26b3e9c546 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:55.240612 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0c1719c4-bd36-49bb-857d-1a26b3e9c546 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:55.517762 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4237835a-96ef-4214-880d-fa340428b16b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:55.524862 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4237835a-96ef-4214-880d-fa340428b16b tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1315 microversion: 2.1 time: 0.393481 Jul 20 11:37:55.525471 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 156/309] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:55 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:55.571374 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0c1719c4-bd36-49bb-857d-1a26b3e9c546 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:55.581041 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0c1719c4-bd36-49bb-857d-1a26b3e9c546 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.360645 Jul 20 11:37:55.591611 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 154/310] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:55 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:37:55.698952 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-de93ad68-93ec-4936-869f-1c4ee3cdcac0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:55.699565 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-de93ad68-93ec-4936-869f-1c4ee3cdcac0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:55.710535 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de93ad68-93ec-4936-869f-1c4ee3cdcac0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:55.710988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de93ad68-93ec-4936-869f-1c4ee3cdcac0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:55.713605 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de93ad68-93ec-4936-869f-1c4ee3cdcac0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:55.714045 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de93ad68-93ec-4936-869f-1c4ee3cdcac0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:55.792533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-e637c619-8bfc-47e4-b890-537cd0beb4dd req-a0156d2c-43c1-4573-8fcd-855d969e34a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77041ff-ede6-4648-99ee-5f97909cbd34", "name": "network-vif-plugged", "status": "completed", "tag": "572c845f-f47f-4120-932d-de63220a9c87"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:55.792533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e637c619-8bfc-47e4-b890-537cd0beb4dd req-a0156d2c-43c1-4573-8fcd-855d969e34a6 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:55.792533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e637c619-8bfc-47e4-b890-537cd0beb4dd req-a0156d2c-43c1-4573-8fcd-855d969e34a6 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:55.810039 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-e637c619-8bfc-47e4-b890-537cd0beb4dd req-a0156d2c-43c1-4573-8fcd-855d969e34a6 service nova] Creating event network-vif-plugged:572c845f-f47f-4120-932d-de63220a9c87 for instance a77041ff-ede6-4648-99ee-5f97909cbd34 on hv-cinder-82282 Jul 20 11:37:55.828420 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-e637c619-8bfc-47e4-b890-537cd0beb4dd req-a0156d2c-43c1-4573-8fcd-855d969e34a6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051870 Jul 20 11:37:55.831544 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 155/311] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:37:55.832431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-de93ad68-93ec-4936-869f-1c4ee3cdcac0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:55.845625 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-de93ad68-93ec-4936-869f-1c4ee3cdcac0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1316 microversion: 2.1 time: 0.150832 Jul 20 11:37:55.846641 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 157/312] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:55 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:56.543798 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3ad46084-ab4e-4607-8c27-9de709fbaa32 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:56.544764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3ad46084-ab4e-4607-8c27-9de709fbaa32 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:56.573831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ad46084-ab4e-4607-8c27-9de709fbaa32 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:56.587242 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ad46084-ab4e-4607-8c27-9de709fbaa32 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:56.593512 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ad46084-ab4e-4607-8c27-9de709fbaa32 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:56.594303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3ad46084-ab4e-4607-8c27-9de709fbaa32 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:56.600021 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ce40228e-9639-4af1-bd6e-2835dee8e7fb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:56.600654 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ce40228e-9639-4af1-bd6e-2835dee8e7fb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:56.628569 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce40228e-9639-4af1-bd6e-2835dee8e7fb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:56.631150 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce40228e-9639-4af1-bd6e-2835dee8e7fb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:56.632045 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce40228e-9639-4af1-bd6e-2835dee8e7fb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:56.637391 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce40228e-9639-4af1-bd6e-2835dee8e7fb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:57.213661 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ce40228e-9639-4af1-bd6e-2835dee8e7fb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:57.225401 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ce40228e-9639-4af1-bd6e-2835dee8e7fb tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1502 microversion: 2.1 time: 0.630640 Jul 20 11:37:57.228310 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 158/313] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:56 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1502 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:57.238913 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3ad46084-ab4e-4607-8c27-9de709fbaa32 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:57.250009 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3ad46084-ab4e-4607-8c27-9de709fbaa32 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1315 microversion: 2.1 time: 0.707866 Jul 20 11:37:57.250607 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 156/314] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:56 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1315 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:57.254898 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4466bcc1-08b5-4610-b296-e5737409aed4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:57.255799 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4466bcc1-08b5-4610-b296-e5737409aed4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:57.272932 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7b0e6e51-cf35-4bef-9840-a786687793ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "093f41ba-a0b4-4354-b7a0-dbec1d4af655"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:57.274249 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7b0e6e51-cf35-4bef-9840-a786687793ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:57.279732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4466bcc1-08b5-4610-b296-e5737409aed4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:57.281310 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4466bcc1-08b5-4610-b296-e5737409aed4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:57.283889 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4466bcc1-08b5-4610-b296-e5737409aed4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:57.286124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4466bcc1-08b5-4610-b296-e5737409aed4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:57.297684 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b0e6e51-cf35-4bef-9840-a786687793ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:57.301399 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b0e6e51-cf35-4bef-9840-a786687793ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:57.305119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b0e6e51-cf35-4bef-9840-a786687793ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:57.306870 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b0e6e51-cf35-4bef-9840-a786687793ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:57.398942 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-7b0e6e51-cf35-4bef-9840-a786687793ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] HTTP exception thrown: Cannot 'attach_volume' instance 67c74b02-2e59-452e-9d39-949b9325a4e4 while it is in vm_state rescued Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7b0e6e51-cf35-4bef-9840-a786687793ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Request method failure captured: Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: POST /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4/os-volume_attachments HTTP/1.1 Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 74 Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-iAGi3InK9o5h93wuwA0y5ZKhv9_XAKhliB9WFK5RjT5ZrOF0JJYFYjtkeiIwNODHDo_KnrpGsMdR8pcBx5HCYKHdHD5VuyuH1iNl2gS4aXxblQodWvSpFJzhwU9a0ybd_eXdwbZ98_NuT-Y4ohecR6FqVlVYRBJMZgmzEOLlYCO8M Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: 9192fe06f92b47cfbc286bb76e97410b Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:37:57.411543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:37:57.413224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9192fe06f92b47cfbc286bb76e97410b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9192fe06f92b47cfbc286bb76e97410b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9192fe06f92b47cfbc286bb76e97410b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9192fe06f92b47cfbc286bb76e97410b"}]}] Jul 20 11:37:57.413224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:37:57.413224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 9192fe06f92b47cfbc286bb76e97410b Jul 20 11:37:57.413224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:37:57.413224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-260660390-project Jul 20 11:37:57.413224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:37:57.413224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:37:57.413224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 51876164aea741cc873ba4755e6c6fcd Jul 20 11:37:57.413224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-260660390-project Jul 20 11:37:57.413224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Jul 20 11:37:57.413224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {"volumeAttachment": {"volumeId": "093f41ba-a0b4-4354-b7a0-dbec1d4af655"}} Jul 20 11:37:57.413224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Cannot 'attach_volume' instance 67c74b02-2e59-452e-9d39-949b9325a4e4 while it is in vm_state rescued Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'server_id': '67c74b02-2e59-452e-9d39-949b9325a4e4', 'body': {'volumeAttachment': {'volumeId': '093f41ba-a0b4-4354-b7a0-dbec1d4af655'}}} Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 67c74b02-2e59-452e-9d39-949b9325a4e4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:37:57.414109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 67c74b02-2e59-452e-9d39-949b9325a4e4 while it is in vm_state rescued Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:37:57.415593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:37:57.416690 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:37:57.416690 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:37:57.416690 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 67c74b02-2e59-452e-9d39-949b9325a4e4 while it is in vm_state rescued Jul 20 11:37:57.416690 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:37:57.416690 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7b0e6e51-cf35-4bef-9840-a786687793ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Returning 409 to user: Cannot 'attach_volume' instance 67c74b02-2e59-452e-9d39-949b9325a4e4 while it is in vm_state rescued {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:37:57.416690 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7b0e6e51-cf35-4bef-9840-a786687793ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "POST /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.160291 Jul 20 11:37:57.416690 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 157/315] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:37:57 2022] POST /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4/os-volume_attachments => generated 152 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:37:57.422594 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1bc301d0-f6c1-4ac4-bcee-d82a20c601c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:57.423133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1bc301d0-f6c1-4ac4-bcee-d82a20c601c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:57.435414 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bc301d0-f6c1-4ac4-bcee-d82a20c601c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:57.436184 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bc301d0-f6c1-4ac4-bcee-d82a20c601c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:57.437192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bc301d0-f6c1-4ac4-bcee-d82a20c601c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:57.437790 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1bc301d0-f6c1-4ac4-bcee-d82a20c601c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:57.719636 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1bc301d0-f6c1-4ac4-bcee-d82a20c601c0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "POST /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4/action" status: 202 len: 0 microversion: 2.1 time: 0.300712 Jul 20 11:37:57.723473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 158/316] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:37:57 2022] POST /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:37:57.731843 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-af3dd403-581d-4452-9254-638837cb5bfc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:57.732826 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-af3dd403-581d-4452-9254-638837cb5bfc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:57.746884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af3dd403-581d-4452-9254-638837cb5bfc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:57.747530 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af3dd403-581d-4452-9254-638837cb5bfc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:57.748324 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af3dd403-581d-4452-9254-638837cb5bfc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:57.748762 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af3dd403-581d-4452-9254-638837cb5bfc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:58.499272 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4466bcc1-08b5-4610-b296-e5737409aed4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:58.525351 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-af3dd403-581d-4452-9254-638837cb5bfc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:58.550919 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-af3dd403-581d-4452-9254-638837cb5bfc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.823801 Jul 20 11:37:58.554847 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 159/317] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:57 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:37:58.556699 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4466bcc1-08b5-4610-b296-e5737409aed4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 1.319675 Jul 20 11:37:58.560640 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 159/318] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:57 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:58.574733 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a8b4875f-1249-4eac-bc1e-d4f0130a18b9 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:58.578449 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a8b4875f-1249-4eac-bc1e-d4f0130a18b9 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:58.594911 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8b4875f-1249-4eac-bc1e-d4f0130a18b9 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:58.594911 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8b4875f-1249-4eac-bc1e-d4f0130a18b9 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:58.604232 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8b4875f-1249-4eac-bc1e-d4f0130a18b9 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:58.605668 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a8b4875f-1249-4eac-bc1e-d4f0130a18b9 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:59.344214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a8b4875f-1249-4eac-bc1e-d4f0130a18b9 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:59.357121 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a8b4875f-1249-4eac-bc1e-d4f0130a18b9 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1315 microversion: 2.1 time: 0.796538 Jul 20 11:37:59.371049 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 160/319] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:58 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:59.411785 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1198122709", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0be9d034-c901-4f78-8d6d-46cf0d873e8d"}], "security_groups": [{"name": "tempest-securitygroup--2043289518"}], "key_name": "tempest-keypair-1628550765", "user_data": "}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:59.575431 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-68aaa0f1-b5c5-40ef-b2e8-37b4fc9b89b1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:59.575431 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-68aaa0f1-b5c5-40ef-b2e8-37b4fc9b89b1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:59.577673 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:59.586592 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68aaa0f1-b5c5-40ef-b2e8-37b4fc9b89b1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:59.588000 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68aaa0f1-b5c5-40ef-b2e8-37b4fc9b89b1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:59.590888 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68aaa0f1-b5c5-40ef-b2e8-37b4fc9b89b1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:59.591490 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68aaa0f1-b5c5-40ef-b2e8-37b4fc9b89b1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:59.629426 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] validate_networks() for [('0be9d034-c901-4f78-8d6d-46cf0d873e8d', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:37:59.642240 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:00.179864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-68aaa0f1-b5c5-40ef-b2e8-37b4fc9b89b1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:00.188205 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-68aaa0f1-b5c5-40ef-b2e8-37b4fc9b89b1 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.620238 Jul 20 11:38:00.199024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 161/320] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:59 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:00.203862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-69ac092e-220e-4af0-8cfe-b8b2f3ab7d68 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:00.204469 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-69ac092e-220e-4af0-8cfe-b8b2f3ab7d68 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:00.221665 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69ac092e-220e-4af0-8cfe-b8b2f3ab7d68 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:00.222137 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69ac092e-220e-4af0-8cfe-b8b2f3ab7d68 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:00.222975 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69ac092e-220e-4af0-8cfe-b8b2f3ab7d68 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:00.223390 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-69ac092e-220e-4af0-8cfe-b8b2f3ab7d68 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:00.766459 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-69ac092e-220e-4af0-8cfe-b8b2f3ab7d68 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:00.775322 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-69ac092e-220e-4af0-8cfe-b8b2f3ab7d68 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.574510 Jul 20 11:38:00.786049 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 162/321] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:00 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:00.792227 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-5a4a45ba-f6ca-4d94-ac21-03ca019c91e9 req-ad676ca5-2fbe-437e-8388-5bc047b44064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ace499-ddc8-4a47-8e3d-730594d57bfa", "tag": "7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:00.809935 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5a4a45ba-f6ca-4d94-ac21-03ca019c91e9 req-ad676ca5-2fbe-437e-8388-5bc047b44064 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:00.810979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5a4a45ba-f6ca-4d94-ac21-03ca019c91e9 req-ad676ca5-2fbe-437e-8388-5bc047b44064 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:00.834674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:38:00.834674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:38:00.834674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:38:00.834674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:38:00.834674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:38:00.836706 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:00.848994 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:00.849672 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:00.851420 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:00.851956 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:00.860130 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-5a4a45ba-f6ca-4d94-ac21-03ca019c91e9 req-ad676ca5-2fbe-437e-8388-5bc047b44064 service nova] Creating event network-changed:7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe for instance d0ace499-ddc8-4a47-8e3d-730594d57bfa on hv-cinder-82282 Jul 20 11:38:00.869398 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-5a4a45ba-f6ca-4d94-ac21-03ca019c91e9 req-ad676ca5-2fbe-437e-8388-5bc047b44064 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081789 Jul 20 11:38:00.876260 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 163/322] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:00.887955 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Getting quotas for project a18ce8b9ff3945ebbbf933d072515d53. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:38:00.888190 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-27d595da-9908-4387-b5bb-a23795b2874c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:00.888761 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-27d595da-9908-4387-b5bb-a23795b2874c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:00.892632 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Getting quotas for user 63bd59ed8f4e4ae28253a9884b727c98 and project a18ce8b9ff3945ebbbf933d072515d53. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:38:00.903663 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27d595da-9908-4387-b5bb-a23795b2874c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:00.904546 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27d595da-9908-4387-b5bb-a23795b2874c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:00.905809 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27d595da-9908-4387-b5bb-a23795b2874c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:00.906557 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-27d595da-9908-4387-b5bb-a23795b2874c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:00.910694 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:38:00.913246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:38:01.031294 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=6 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:01.101778 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-27d595da-9908-4387-b5bb-a23795b2874c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:01.105571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:01.111312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-27d595da-9908-4387-b5bb-a23795b2874c tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1464 microversion: 2.1 time: 0.233165 Jul 20 11:38:01.112594 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 164/323] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:00 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1464 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:01.207326 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-443b8a5a-98ad-420f-8f9a-d6e63dab4983 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:01.223803 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-443b8a5a-98ad-420f-8f9a-d6e63dab4983 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:01.229310 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-443b8a5a-98ad-420f-8f9a-d6e63dab4983 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:01.232109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-443b8a5a-98ad-420f-8f9a-d6e63dab4983 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:01.234546 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-443b8a5a-98ad-420f-8f9a-d6e63dab4983 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:01.235261 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-443b8a5a-98ad-420f-8f9a-d6e63dab4983 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:01.293542 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-104ed434-a45d-40de-823c-52c6bb629562 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.887007 Jul 20 11:38:01.298751 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 160/324] 10.222.0.43 () {62 vars in 1187 bytes} [Wed Jul 20 11:37:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 11:38:01.357230 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9953b471-1ec9-4ff3-80e0-71b9966a5414 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:01.357366 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9953b471-1ec9-4ff3-80e0-71b9966a5414 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:01.499510 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9953b471-1ec9-4ff3-80e0-71b9966a5414 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:01.519928 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9953b471-1ec9-4ff3-80e0-71b9966a5414 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:01.521597 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9953b471-1ec9-4ff3-80e0-71b9966a5414 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:01.522743 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9953b471-1ec9-4ff3-80e0-71b9966a5414 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1282 microversion: 2.20 time: 0.217563 Jul 20 11:38:01.528565 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 161/325] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:01 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1282 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:01.536772 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-adf260cd-fd97-48cd-9d86-7fffe03d511f tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:01.537753 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-adf260cd-fd97-48cd-9d86-7fffe03d511f tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:01.553348 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adf260cd-fd97-48cd-9d86-7fffe03d511f tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:01.554278 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adf260cd-fd97-48cd-9d86-7fffe03d511f tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:01.558079 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adf260cd-fd97-48cd-9d86-7fffe03d511f tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:01.558789 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-adf260cd-fd97-48cd-9d86-7fffe03d511f tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:01.599604 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-443b8a5a-98ad-420f-8f9a-d6e63dab4983 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:01.607614 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-443b8a5a-98ad-420f-8f9a-d6e63dab4983 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.404711 Jul 20 11:38:01.609077 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 165/326] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:01 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:01.613096 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-adf260cd-fd97-48cd-9d86-7fffe03d511f tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:38:01.795241 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f6ca258a-2212-45c1-be1d-62729093359f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:01.796276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f6ca258a-2212-45c1-be1d-62729093359f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:01.803947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6ca258a-2212-45c1-be1d-62729093359f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:01.804381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6ca258a-2212-45c1-be1d-62729093359f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:01.806990 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6ca258a-2212-45c1-be1d-62729093359f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:01.806990 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6ca258a-2212-45c1-be1d-62729093359f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:01.989202 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-adf260cd-fd97-48cd-9d86-7fffe03d511f tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 204 len: 0 microversion: 2.1 time: 0.459294 Jul 20 11:38:01.990074 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 162/327] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:38:01 2022] DELETE /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:38:01.999550 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e6413065-f7d7-40db-8055-8db1cc6738ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:02.000575 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e6413065-f7d7-40db-8055-8db1cc6738ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:02.012058 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6413065-f7d7-40db-8055-8db1cc6738ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:02.012058 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6413065-f7d7-40db-8055-8db1cc6738ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:02.021853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6413065-f7d7-40db-8055-8db1cc6738ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:02.022604 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6413065-f7d7-40db-8055-8db1cc6738ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:02.027142 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f6ca258a-2212-45c1-be1d-62729093359f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:02.029294 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:02.036973 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f6ca258a-2212-45c1-be1d-62729093359f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.246841 Jul 20 11:38:02.038968 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 166/328] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:01 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:02.246791 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e6413065-f7d7-40db-8055-8db1cc6738ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:02.254454 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e6413065-f7d7-40db-8055-8db1cc6738ec tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1470 microversion: 2.1 time: 0.259369 Jul 20 11:38:02.258272 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 163/329] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:01 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1470 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:02.540353 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1dfbb2e7-097f-4c11-bc8a-5a903b78834f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:02.541896 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1dfbb2e7-097f-4c11-bc8a-5a903b78834f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:02.623678 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1dfbb2e7-097f-4c11-bc8a-5a903b78834f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:02.629278 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3804db94-a7e1-4bee-a3cc-5e240f2f02d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:02.630627 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3804db94-a7e1-4bee-a3cc-5e240f2f02d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:02.635755 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1dfbb2e7-097f-4c11-bc8a-5a903b78834f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:02.637878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1dfbb2e7-097f-4c11-bc8a-5a903b78834f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:02.641111 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1dfbb2e7-097f-4c11-bc8a-5a903b78834f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1282 microversion: 2.20 time: 0.104878 Jul 20 11:38:02.644507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 167/330] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:02 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:38:02.652574 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3804db94-a7e1-4bee-a3cc-5e240f2f02d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:02.654800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3804db94-a7e1-4bee-a3cc-5e240f2f02d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:02.655916 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3804db94-a7e1-4bee-a3cc-5e240f2f02d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:02.656606 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3804db94-a7e1-4bee-a3cc-5e240f2f02d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:02.845490 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3804db94-a7e1-4bee-a3cc-5e240f2f02d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:02.853889 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3804db94-a7e1-4bee-a3cc-5e240f2f02d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.230397 Jul 20 11:38:02.854712 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 164/331] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:02 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:03.057603 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0dc71203-8eed-43de-b16d-a520294f1e0f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:03.063581 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0dc71203-8eed-43de-b16d-a520294f1e0f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:03.064597 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dc71203-8eed-43de-b16d-a520294f1e0f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:03.065074 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dc71203-8eed-43de-b16d-a520294f1e0f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:03.065851 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dc71203-8eed-43de-b16d-a520294f1e0f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:03.066457 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dc71203-8eed-43de-b16d-a520294f1e0f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:03.240103 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0dc71203-8eed-43de-b16d-a520294f1e0f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:03.262291 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0dc71203-8eed-43de-b16d-a520294f1e0f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.210167 Jul 20 11:38:03.266267 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 168/332] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:03 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:03.278316 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ac894642-f900-4a7e-af00-95c515953729 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:03.278936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ac894642-f900-4a7e-af00-95c515953729 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:03.286837 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac894642-f900-4a7e-af00-95c515953729 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:03.289340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac894642-f900-4a7e-af00-95c515953729 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:03.291934 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac894642-f900-4a7e-af00-95c515953729 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:03.293171 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac894642-f900-4a7e-af00-95c515953729 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:03.490396 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ac894642-f900-4a7e-af00-95c515953729 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:03.498392 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ac894642-f900-4a7e-af00-95c515953729 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1470 microversion: 2.1 time: 0.226739 Jul 20 11:38:03.499554 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 165/333] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:03 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:03.666160 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dd74577e-79bd-4e96-ab56-ff5c601195cd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:03.667136 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dd74577e-79bd-4e96-ab56-ff5c601195cd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:03.673409 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd74577e-79bd-4e96-ab56-ff5c601195cd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:03.674381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd74577e-79bd-4e96-ab56-ff5c601195cd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:03.674679 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd74577e-79bd-4e96-ab56-ff5c601195cd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:03.675112 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd74577e-79bd-4e96-ab56-ff5c601195cd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:03.741053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dd74577e-79bd-4e96-ab56-ff5c601195cd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:03.749366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dd74577e-79bd-4e96-ab56-ff5c601195cd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:03.750858 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dd74577e-79bd-4e96-ab56-ff5c601195cd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:03.753208 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dd74577e-79bd-4e96-ab56-ff5c601195cd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1286 microversion: 2.20 time: 0.090435 Jul 20 11:38:03.753764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 169/334] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:03 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:03.871814 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-32f098f9-b8ae-4f25-ad8e-ddf397384096 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:03.872474 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-32f098f9-b8ae-4f25-ad8e-ddf397384096 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:03.879454 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32f098f9-b8ae-4f25-ad8e-ddf397384096 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:03.883073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32f098f9-b8ae-4f25-ad8e-ddf397384096 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:03.883073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32f098f9-b8ae-4f25-ad8e-ddf397384096 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:03.883073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-32f098f9-b8ae-4f25-ad8e-ddf397384096 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:04.040502 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-32f098f9-b8ae-4f25-ad8e-ddf397384096 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:04.047955 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-32f098f9-b8ae-4f25-ad8e-ddf397384096 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.180317 Jul 20 11:38:04.048516 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 166/335] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:03 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:04.282083 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a29de1d2-8c62-418d-abd3-7b226627c32e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:04.282864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a29de1d2-8c62-418d-abd3-7b226627c32e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:04.289264 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a29de1d2-8c62-418d-abd3-7b226627c32e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:04.289730 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a29de1d2-8c62-418d-abd3-7b226627c32e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:04.291228 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a29de1d2-8c62-418d-abd3-7b226627c32e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:04.291659 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a29de1d2-8c62-418d-abd3-7b226627c32e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:04.445593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a29de1d2-8c62-418d-abd3-7b226627c32e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:04.454151 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a29de1d2-8c62-418d-abd3-7b226627c32e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.176415 Jul 20 11:38:04.455076 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 170/336] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:04 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:04.516711 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8a44a0b7-4c45-4b95-a729-7f23a91deb86 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:04.517386 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8a44a0b7-4c45-4b95-a729-7f23a91deb86 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:04.524575 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a44a0b7-4c45-4b95-a729-7f23a91deb86 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:04.525185 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a44a0b7-4c45-4b95-a729-7f23a91deb86 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:04.525981 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a44a0b7-4c45-4b95-a729-7f23a91deb86 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:04.526417 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8a44a0b7-4c45-4b95-a729-7f23a91deb86 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:04.671969 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8a44a0b7-4c45-4b95-a729-7f23a91deb86 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:04.681638 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8a44a0b7-4c45-4b95-a729-7f23a91deb86 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1470 microversion: 2.1 time: 0.168488 Jul 20 11:38:04.682488 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 167/337] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:04 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:04.774613 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a383843-0158-4143-9894-c02b82ac7dd1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:04.775247 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6a383843-0158-4143-9894-c02b82ac7dd1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:04.790979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a383843-0158-4143-9894-c02b82ac7dd1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:04.791522 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a383843-0158-4143-9894-c02b82ac7dd1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:04.792317 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a383843-0158-4143-9894-c02b82ac7dd1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:04.792741 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a383843-0158-4143-9894-c02b82ac7dd1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:04.901238 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a383843-0158-4143-9894-c02b82ac7dd1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:04.911092 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a383843-0158-4143-9894-c02b82ac7dd1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:04.920310 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a383843-0158-4143-9894-c02b82ac7dd1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:04.921666 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a383843-0158-4143-9894-c02b82ac7dd1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1286 microversion: 2.20 time: 0.153583 Jul 20 11:38:04.922609 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 171/338] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:04 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1286 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:05.064829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-acb0337c-9a6c-42e0-bbc5-a20d99b51806 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:05.065802 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-acb0337c-9a6c-42e0-bbc5-a20d99b51806 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:05.074001 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acb0337c-9a6c-42e0-bbc5-a20d99b51806 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:05.074839 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acb0337c-9a6c-42e0-bbc5-a20d99b51806 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:05.075853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acb0337c-9a6c-42e0-bbc5-a20d99b51806 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:05.076655 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-acb0337c-9a6c-42e0-bbc5-a20d99b51806 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:05.247023 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-acb0337c-9a6c-42e0-bbc5-a20d99b51806 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:05.255994 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-acb0337c-9a6c-42e0-bbc5-a20d99b51806 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.194921 Jul 20 11:38:05.257187 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 168/339] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:05 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:05.480290 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-db460eeb-4ac9-447e-bcd9-a5b3512300ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:05.481177 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-db460eeb-4ac9-447e-bcd9-a5b3512300ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:05.497748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db460eeb-4ac9-447e-bcd9-a5b3512300ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:05.497748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db460eeb-4ac9-447e-bcd9-a5b3512300ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:05.497748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db460eeb-4ac9-447e-bcd9-a5b3512300ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:05.497748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-db460eeb-4ac9-447e-bcd9-a5b3512300ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:05.677894 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-db460eeb-4ac9-447e-bcd9-a5b3512300ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:05.687117 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-db460eeb-4ac9-447e-bcd9-a5b3512300ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.219196 Jul 20 11:38:05.687686 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 172/340] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:05 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:05.701709 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-54bc13e5-7148-44b0-851e-9e750daab40d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:05.702326 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-54bc13e5-7148-44b0-851e-9e750daab40d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:05.710460 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54bc13e5-7148-44b0-851e-9e750daab40d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:05.710460 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54bc13e5-7148-44b0-851e-9e750daab40d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:05.710734 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54bc13e5-7148-44b0-851e-9e750daab40d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:05.711253 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-54bc13e5-7148-44b0-851e-9e750daab40d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:05.950514 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1da491d2-d998-4d66-95a3-d338a7a1bf39 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:05.951695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1da491d2-d998-4d66-95a3-d338a7a1bf39 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:05.973065 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1da491d2-d998-4d66-95a3-d338a7a1bf39 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:05.975141 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1da491d2-d998-4d66-95a3-d338a7a1bf39 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:05.976087 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1da491d2-d998-4d66-95a3-d338a7a1bf39 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:05.979570 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1da491d2-d998-4d66-95a3-d338a7a1bf39 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:06.074715 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-54bc13e5-7148-44b0-851e-9e750daab40d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:06.091933 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-54bc13e5-7148-44b0-851e-9e750daab40d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1470 microversion: 2.1 time: 0.393960 Jul 20 11:38:06.103377 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 169/341] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:05 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1470 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:06.133455 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1da491d2-d998-4d66-95a3-d338a7a1bf39 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:06.145572 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1da491d2-d998-4d66-95a3-d338a7a1bf39 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:06.148744 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1da491d2-d998-4d66-95a3-d338a7a1bf39 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:06.150492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1da491d2-d998-4d66-95a3-d338a7a1bf39 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1286 microversion: 2.20 time: 0.206720 Jul 20 11:38:06.151235 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 173/342] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:05 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:06.275933 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5d95bb84-6597-4280-bbd7-ff0f1d996ac3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:06.277335 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5d95bb84-6597-4280-bbd7-ff0f1d996ac3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:06.284375 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d95bb84-6597-4280-bbd7-ff0f1d996ac3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:06.285922 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d95bb84-6597-4280-bbd7-ff0f1d996ac3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:06.285922 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d95bb84-6597-4280-bbd7-ff0f1d996ac3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:06.286263 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5d95bb84-6597-4280-bbd7-ff0f1d996ac3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:06.442393 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5d95bb84-6597-4280-bbd7-ff0f1d996ac3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:06.453075 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5d95bb84-6597-4280-bbd7-ff0f1d996ac3 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.181963 Jul 20 11:38:06.453642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 170/343] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:06 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:06.703835 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c14ac721-6b35-4a32-95bf-af100a473bc9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:06.704413 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c14ac721-6b35-4a32-95bf-af100a473bc9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:06.710382 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c14ac721-6b35-4a32-95bf-af100a473bc9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:06.710827 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c14ac721-6b35-4a32-95bf-af100a473bc9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:06.711588 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c14ac721-6b35-4a32-95bf-af100a473bc9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:06.712025 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c14ac721-6b35-4a32-95bf-af100a473bc9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:06.851913 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c14ac721-6b35-4a32-95bf-af100a473bc9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:06.859319 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c14ac721-6b35-4a32-95bf-af100a473bc9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.159552 Jul 20 11:38:06.859879 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 174/344] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:06 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:07.122196 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3d063d9d-a5ca-43ee-b068-4ef13a57f1bb tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:07.122806 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3d063d9d-a5ca-43ee-b068-4ef13a57f1bb tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:07.129613 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d063d9d-a5ca-43ee-b068-4ef13a57f1bb tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:07.130062 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d063d9d-a5ca-43ee-b068-4ef13a57f1bb tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:07.130862 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d063d9d-a5ca-43ee-b068-4ef13a57f1bb tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:07.131293 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3d063d9d-a5ca-43ee-b068-4ef13a57f1bb tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:07.169784 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bfe4f0ad-c6d4-4023-993e-b086045a9d31 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:07.171075 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bfe4f0ad-c6d4-4023-993e-b086045a9d31 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:07.178296 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bfe4f0ad-c6d4-4023-993e-b086045a9d31 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:07.178761 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bfe4f0ad-c6d4-4023-993e-b086045a9d31 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:07.180328 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bfe4f0ad-c6d4-4023-993e-b086045a9d31 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:07.180804 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bfe4f0ad-c6d4-4023-993e-b086045a9d31 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:07.272681 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bfe4f0ad-c6d4-4023-993e-b086045a9d31 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:07.286595 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bfe4f0ad-c6d4-4023-993e-b086045a9d31 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:07.289418 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bfe4f0ad-c6d4-4023-993e-b086045a9d31 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:07.291527 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bfe4f0ad-c6d4-4023-993e-b086045a9d31 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1286 microversion: 2.20 time: 0.127315 Jul 20 11:38:07.292364 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 175/345] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:07 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1286 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:38:07.326279 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3d063d9d-a5ca-43ee-b068-4ef13a57f1bb tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:07.334331 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3d063d9d-a5ca-43ee-b068-4ef13a57f1bb tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1470 microversion: 2.1 time: 0.216664 Jul 20 11:38:07.334917 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 171/346] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:07 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1470 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:07.473107 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a2adf380-1362-4e19-9c5b-f5085651dd52 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:07.474159 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a2adf380-1362-4e19-9c5b-f5085651dd52 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:07.484110 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2adf380-1362-4e19-9c5b-f5085651dd52 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:07.484878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2adf380-1362-4e19-9c5b-f5085651dd52 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:07.485617 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2adf380-1362-4e19-9c5b-f5085651dd52 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:07.486051 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a2adf380-1362-4e19-9c5b-f5085651dd52 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:07.650174 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a2adf380-1362-4e19-9c5b-f5085651dd52 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:07.658091 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a2adf380-1362-4e19-9c5b-f5085651dd52 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.191363 Jul 20 11:38:07.658676 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 176/347] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:07 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:07.876494 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-90f77e22-f0f2-4407-a069-4989de5d3ad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:07.877140 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-90f77e22-f0f2-4407-a069-4989de5d3ad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:07.885351 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90f77e22-f0f2-4407-a069-4989de5d3ad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:07.885837 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90f77e22-f0f2-4407-a069-4989de5d3ad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:07.889811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90f77e22-f0f2-4407-a069-4989de5d3ad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:07.889811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90f77e22-f0f2-4407-a069-4989de5d3ad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:08.103296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90f77e22-f0f2-4407-a069-4989de5d3ad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:08.111797 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-90f77e22-f0f2-4407-a069-4989de5d3ad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.239043 Jul 20 11:38:08.112378 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 172/348] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:07 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:08.310616 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-76000f01-085c-4d82-b6c1-06ba9a3355aa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:08.311236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-76000f01-085c-4d82-b6c1-06ba9a3355aa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:08.317502 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76000f01-085c-4d82-b6c1-06ba9a3355aa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:08.323471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76000f01-085c-4d82-b6c1-06ba9a3355aa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:08.323471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76000f01-085c-4d82-b6c1-06ba9a3355aa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:08.323471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76000f01-085c-4d82-b6c1-06ba9a3355aa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:08.357405 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8c921b54-a94f-453a-9578-933f73ec52ed tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:08.369939 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8c921b54-a94f-453a-9578-933f73ec52ed tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:08.390338 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c921b54-a94f-453a-9578-933f73ec52ed tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:08.390799 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c921b54-a94f-453a-9578-933f73ec52ed tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:08.391612 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c921b54-a94f-453a-9578-933f73ec52ed tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:08.392048 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8c921b54-a94f-453a-9578-933f73ec52ed tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:08.405067 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-76000f01-085c-4d82-b6c1-06ba9a3355aa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:08.414143 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-76000f01-085c-4d82-b6c1-06ba9a3355aa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:08.415704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-76000f01-085c-4d82-b6c1-06ba9a3355aa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:08.416860 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-76000f01-085c-4d82-b6c1-06ba9a3355aa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1286 microversion: 2.20 time: 0.110854 Jul 20 11:38:08.417673 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 177/349] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:08 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:08.555340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8c921b54-a94f-453a-9578-933f73ec52ed tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:08.564561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8c921b54-a94f-453a-9578-933f73ec52ed tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1470 microversion: 2.1 time: 0.211660 Jul 20 11:38:08.565192 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 173/350] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:08 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1470 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:08.675565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4138fa26-090a-4897-80c2-4091d95c8ce8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:08.676287 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4138fa26-090a-4897-80c2-4091d95c8ce8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:08.684336 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4138fa26-090a-4897-80c2-4091d95c8ce8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:08.685162 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4138fa26-090a-4897-80c2-4091d95c8ce8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:08.686176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4138fa26-090a-4897-80c2-4091d95c8ce8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:08.686844 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4138fa26-090a-4897-80c2-4091d95c8ce8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:08.838596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4138fa26-090a-4897-80c2-4091d95c8ce8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:08.847142 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4138fa26-090a-4897-80c2-4091d95c8ce8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.175323 Jul 20 11:38:08.847730 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 178/351] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:08 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:09.129540 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3dcc0a4c-9fe3-43c4-ad8e-13af196ac713 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:09.130398 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3dcc0a4c-9fe3-43c4-ad8e-13af196ac713 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:09.137316 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dcc0a4c-9fe3-43c4-ad8e-13af196ac713 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:09.149961 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dcc0a4c-9fe3-43c4-ad8e-13af196ac713 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:09.150801 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dcc0a4c-9fe3-43c4-ad8e-13af196ac713 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:09.151237 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3dcc0a4c-9fe3-43c4-ad8e-13af196ac713 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:09.305246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3dcc0a4c-9fe3-43c4-ad8e-13af196ac713 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:09.313922 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3dcc0a4c-9fe3-43c4-ad8e-13af196ac713 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.188356 Jul 20 11:38:09.314849 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 174/352] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:09 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:09.437100 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-98e402d1-7db2-4c00-9b43-50f449a051f4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:09.438304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-98e402d1-7db2-4c00-9b43-50f449a051f4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:09.444237 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98e402d1-7db2-4c00-9b43-50f449a051f4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:09.444674 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98e402d1-7db2-4c00-9b43-50f449a051f4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:09.445474 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98e402d1-7db2-4c00-9b43-50f449a051f4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:09.445904 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-98e402d1-7db2-4c00-9b43-50f449a051f4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:09.512756 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-98e402d1-7db2-4c00-9b43-50f449a051f4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:09.520862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-98e402d1-7db2-4c00-9b43-50f449a051f4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:09.522461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-98e402d1-7db2-4c00-9b43-50f449a051f4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:09.523645 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-98e402d1-7db2-4c00-9b43-50f449a051f4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1286 microversion: 2.20 time: 0.091685 Jul 20 11:38:09.524535 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 179/353] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:09 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:09.582179 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-af36b96a-0ec2-4160-9060-4ba1df115111 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:09.583072 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-af36b96a-0ec2-4160-9060-4ba1df115111 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:09.590017 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af36b96a-0ec2-4160-9060-4ba1df115111 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:09.590460 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af36b96a-0ec2-4160-9060-4ba1df115111 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:09.591229 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af36b96a-0ec2-4160-9060-4ba1df115111 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:09.591660 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af36b96a-0ec2-4160-9060-4ba1df115111 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:09.728678 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-af36b96a-0ec2-4160-9060-4ba1df115111 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:09.737126 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-af36b96a-0ec2-4160-9060-4ba1df115111 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1470 microversion: 2.1 time: 0.158140 Jul 20 11:38:09.737126 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 175/354] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:09 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:09.866054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-780f0736-2934-4475-bbdf-33a7f33438ad tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:09.866653 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-780f0736-2934-4475-bbdf-33a7f33438ad tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:09.872832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-780f0736-2934-4475-bbdf-33a7f33438ad tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:09.873082 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-780f0736-2934-4475-bbdf-33a7f33438ad tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:09.873847 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-780f0736-2934-4475-bbdf-33a7f33438ad tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:09.874276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-780f0736-2934-4475-bbdf-33a7f33438ad tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:10.007878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-780f0736-2934-4475-bbdf-33a7f33438ad tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:10.020300 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-780f0736-2934-4475-bbdf-33a7f33438ad tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.158342 Jul 20 11:38:10.024384 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 180/355] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:09 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:10.340768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-eef4216c-653a-48e3-a953-f456966e65db tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:10.341412 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-eef4216c-653a-48e3-a953-f456966e65db tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:10.351794 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eef4216c-653a-48e3-a953-f456966e65db tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:10.352248 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eef4216c-653a-48e3-a953-f456966e65db tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:10.353169 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eef4216c-653a-48e3-a953-f456966e65db tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:10.353608 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-eef4216c-653a-48e3-a953-f456966e65db tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:10.491541 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-eef4216c-653a-48e3-a953-f456966e65db tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:10.499648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-eef4216c-653a-48e3-a953-f456966e65db tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.171948 Jul 20 11:38:10.500204 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 176/356] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:10 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:10.543274 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-52958073-9d43-43a0-a38f-d14f6c7f10f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:10.543864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-52958073-9d43-43a0-a38f-d14f6c7f10f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:10.549957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52958073-9d43-43a0-a38f-d14f6c7f10f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:10.550402 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52958073-9d43-43a0-a38f-d14f6c7f10f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:10.551178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52958073-9d43-43a0-a38f-d14f6c7f10f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:10.551614 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-52958073-9d43-43a0-a38f-d14f6c7f10f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:10.623996 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52958073-9d43-43a0-a38f-d14f6c7f10f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:10.632284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52958073-9d43-43a0-a38f-d14f6c7f10f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:10.633833 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-52958073-9d43-43a0-a38f-d14f6c7f10f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:10.637389 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-52958073-9d43-43a0-a38f-d14f6c7f10f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1286 microversion: 2.20 time: 0.096620 Jul 20 11:38:10.637389 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 181/357] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:10 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:10.754273 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57fce8e0-aff8-428a-918c-19afb34b21c3 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:10.754897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57fce8e0-aff8-428a-918c-19afb34b21c3 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:10.762195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57fce8e0-aff8-428a-918c-19afb34b21c3 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:10.762636 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57fce8e0-aff8-428a-918c-19afb34b21c3 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:10.763390 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57fce8e0-aff8-428a-918c-19afb34b21c3 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:10.763814 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57fce8e0-aff8-428a-918c-19afb34b21c3 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:10.877489 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:10.903025 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57fce8e0-aff8-428a-918c-19afb34b21c3 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:10.910805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57fce8e0-aff8-428a-918c-19afb34b21c3 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1470 microversion: 2.1 time: 0.160436 Jul 20 11:38:10.911372 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 177/358] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:10 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:11.042342 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-156d056e-128d-4fdf-bd17-c9f07f823f3a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:11.043132 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-156d056e-128d-4fdf-bd17-c9f07f823f3a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:11.049514 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-156d056e-128d-4fdf-bd17-c9f07f823f3a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:11.049912 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-156d056e-128d-4fdf-bd17-c9f07f823f3a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:11.050671 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-156d056e-128d-4fdf-bd17-c9f07f823f3a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:11.051097 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-156d056e-128d-4fdf-bd17-c9f07f823f3a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:11.069717 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:11.187831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-156d056e-128d-4fdf-bd17-c9f07f823f3a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:11.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-156d056e-128d-4fdf-bd17-c9f07f823f3a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.157235 Jul 20 11:38:11.197041 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 182/359] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:11 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:11.517243 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d3e14544-e45e-491a-92ec-834ba5c35fb4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:11.517853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d3e14544-e45e-491a-92ec-834ba5c35fb4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:11.519632 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=20 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:11.525323 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3e14544-e45e-491a-92ec-834ba5c35fb4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:11.528123 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3e14544-e45e-491a-92ec-834ba5c35fb4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:11.528123 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3e14544-e45e-491a-92ec-834ba5c35fb4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:11.528123 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d3e14544-e45e-491a-92ec-834ba5c35fb4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:11.653687 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bf610d0a-2951-4cb3-9b15-36272bf225c3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:11.654287 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bf610d0a-2951-4cb3-9b15-36272bf225c3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:11.660105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf610d0a-2951-4cb3-9b15-36272bf225c3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:11.660547 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf610d0a-2951-4cb3-9b15-36272bf225c3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:11.661341 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf610d0a-2951-4cb3-9b15-36272bf225c3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:11.661798 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf610d0a-2951-4cb3-9b15-36272bf225c3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:11.674109 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d3e14544-e45e-491a-92ec-834ba5c35fb4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:11.686284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d3e14544-e45e-491a-92ec-834ba5c35fb4 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.173189 Jul 20 11:38:11.686866 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 178/360] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:11 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:11.738506 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf610d0a-2951-4cb3-9b15-36272bf225c3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:11.746679 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf610d0a-2951-4cb3-9b15-36272bf225c3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:11.748198 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf610d0a-2951-4cb3-9b15-36272bf225c3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:11.749334 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bf610d0a-2951-4cb3-9b15-36272bf225c3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1286 microversion: 2.20 time: 0.100186 Jul 20 11:38:11.749891 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 183/361] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:11 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:38:11.927257 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a6950b9e-58cf-4696-b0da-b012ec8750aa tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:11.931308 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a6950b9e-58cf-4696-b0da-b012ec8750aa tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:11.935264 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6950b9e-58cf-4696-b0da-b012ec8750aa tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:11.935715 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6950b9e-58cf-4696-b0da-b012ec8750aa tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:11.936482 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6950b9e-58cf-4696-b0da-b012ec8750aa tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:11.936955 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a6950b9e-58cf-4696-b0da-b012ec8750aa tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:12.079556 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a6950b9e-58cf-4696-b0da-b012ec8750aa tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:12.083231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:12.088468 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a6950b9e-58cf-4696-b0da-b012ec8750aa tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1470 microversion: 2.1 time: 0.164901 Jul 20 11:38:12.093014 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 179/362] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:11 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:12.212326 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a9630f31-b2ef-4cf0-948a-20b8d8968dca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:12.212979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a9630f31-b2ef-4cf0-948a-20b8d8968dca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:12.219189 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9630f31-b2ef-4cf0-948a-20b8d8968dca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:12.219635 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9630f31-b2ef-4cf0-948a-20b8d8968dca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:12.220393 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9630f31-b2ef-4cf0-948a-20b8d8968dca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:12.220860 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9630f31-b2ef-4cf0-948a-20b8d8968dca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:12.351416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a9630f31-b2ef-4cf0-948a-20b8d8968dca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:12.359539 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a9630f31-b2ef-4cf0-948a-20b8d8968dca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.151129 Jul 20 11:38:12.360102 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 184/363] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:12 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:12.706301 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-af7e86fc-75ac-4406-b2f1-a7a600b033f3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:12.706908 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-af7e86fc-75ac-4406-b2f1-a7a600b033f3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:12.714080 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af7e86fc-75ac-4406-b2f1-a7a600b033f3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:12.714527 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af7e86fc-75ac-4406-b2f1-a7a600b033f3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:12.715281 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af7e86fc-75ac-4406-b2f1-a7a600b033f3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:12.715714 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-af7e86fc-75ac-4406-b2f1-a7a600b033f3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:12.767534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0bce503a-f9ed-4d13-a18b-420c892590d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:12.768284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0bce503a-f9ed-4d13-a18b-420c892590d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:12.771143 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:12.774668 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bce503a-f9ed-4d13-a18b-420c892590d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:12.777018 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bce503a-f9ed-4d13-a18b-420c892590d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:12.777018 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bce503a-f9ed-4d13-a18b-420c892590d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:12.777018 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bce503a-f9ed-4d13-a18b-420c892590d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:12.846853 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0bce503a-f9ed-4d13-a18b-420c892590d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:12.855644 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0bce503a-f9ed-4d13-a18b-420c892590d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:12.857191 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0bce503a-f9ed-4d13-a18b-420c892590d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:12.858424 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0bce503a-f9ed-4d13-a18b-420c892590d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1286 microversion: 2.20 time: 0.094866 Jul 20 11:38:12.859098 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 185/364] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:12 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:38:12.880337 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-af7e86fc-75ac-4406-b2f1-a7a600b033f3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:12.887589 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-af7e86fc-75ac-4406-b2f1-a7a600b033f3 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.185145 Jul 20 11:38:12.888151 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 180/365] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:12 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:13.107296 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b5ab0a92-3eff-4588-bc1d-896be02644d0 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:13.107975 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b5ab0a92-3eff-4588-bc1d-896be02644d0 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:13.115053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5ab0a92-3eff-4588-bc1d-896be02644d0 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:13.115569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5ab0a92-3eff-4588-bc1d-896be02644d0 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:13.116404 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5ab0a92-3eff-4588-bc1d-896be02644d0 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:13.116983 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5ab0a92-3eff-4588-bc1d-896be02644d0 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:13.247875 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b5ab0a92-3eff-4588-bc1d-896be02644d0 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:13.257035 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b5ab0a92-3eff-4588-bc1d-896be02644d0 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1470 microversion: 2.1 time: 0.154119 Jul 20 11:38:13.257706 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 186/366] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:13 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:13.376725 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-302075a9-ebd3-40ef-a465-cbd00f4069a9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:13.377363 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-302075a9-ebd3-40ef-a465-cbd00f4069a9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:13.383842 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-302075a9-ebd3-40ef-a465-cbd00f4069a9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:13.384293 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-302075a9-ebd3-40ef-a465-cbd00f4069a9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:13.385997 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-302075a9-ebd3-40ef-a465-cbd00f4069a9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:13.386438 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-302075a9-ebd3-40ef-a465-cbd00f4069a9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:13.523720 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-302075a9-ebd3-40ef-a465-cbd00f4069a9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:13.531285 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-302075a9-ebd3-40ef-a465-cbd00f4069a9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.158465 Jul 20 11:38:13.531848 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 181/367] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:13 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:13.876534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0ac82160-078e-4a02-830b-4054c3381605 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:13.877165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0ac82160-078e-4a02-830b-4054c3381605 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:13.884136 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ac82160-078e-4a02-830b-4054c3381605 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:13.889251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ac82160-078e-4a02-830b-4054c3381605 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:13.889251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ac82160-078e-4a02-830b-4054c3381605 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:13.889251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0ac82160-078e-4a02-830b-4054c3381605 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:13.904430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f28e634-4131-4170-a30a-ffeb4420c34f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:13.905224 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f28e634-4131-4170-a30a-ffeb4420c34f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:13.911332 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f28e634-4131-4170-a30a-ffeb4420c34f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:13.912062 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f28e634-4131-4170-a30a-ffeb4420c34f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:13.912558 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f28e634-4131-4170-a30a-ffeb4420c34f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:13.913015 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f28e634-4131-4170-a30a-ffeb4420c34f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:13.950897 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0ac82160-078e-4a02-830b-4054c3381605 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:13.959091 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0ac82160-078e-4a02-830b-4054c3381605 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:13.960598 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0ac82160-078e-4a02-830b-4054c3381605 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:13.961727 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0ac82160-078e-4a02-830b-4054c3381605 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1286 microversion: 2.20 time: 0.089108 Jul 20 11:38:13.962288 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 187/368] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:13 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:14.045835 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f28e634-4131-4170-a30a-ffeb4420c34f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:14.053795 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f28e634-4131-4170-a30a-ffeb4420c34f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.152900 Jul 20 11:38:14.055103 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 182/369] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:13 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:14.274477 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b00e100b-79ee-4287-accb-948828a09b5d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:14.275127 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b00e100b-79ee-4287-accb-948828a09b5d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:14.281785 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b00e100b-79ee-4287-accb-948828a09b5d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:14.282232 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b00e100b-79ee-4287-accb-948828a09b5d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:14.282988 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b00e100b-79ee-4287-accb-948828a09b5d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:14.283425 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b00e100b-79ee-4287-accb-948828a09b5d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:14.413654 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b00e100b-79ee-4287-accb-948828a09b5d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:14.421730 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b00e100b-79ee-4287-accb-948828a09b5d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1470 microversion: 2.1 time: 0.151159 Jul 20 11:38:14.422294 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 188/370] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:14 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:14.547511 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3188d07d-8292-458b-8fb2-226ef31de4ed tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:14.548111 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3188d07d-8292-458b-8fb2-226ef31de4ed tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:14.554526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3188d07d-8292-458b-8fb2-226ef31de4ed tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:14.554965 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3188d07d-8292-458b-8fb2-226ef31de4ed tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:14.555710 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3188d07d-8292-458b-8fb2-226ef31de4ed tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:14.556135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3188d07d-8292-458b-8fb2-226ef31de4ed tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:14.693505 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3188d07d-8292-458b-8fb2-226ef31de4ed tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:14.702506 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3188d07d-8292-458b-8fb2-226ef31de4ed tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.153205 Jul 20 11:38:14.702506 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 183/371] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:14 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:14.979485 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3eb10f95-1571-4ef6-8555-a00ac3658ff5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:14.980093 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3eb10f95-1571-4ef6-8555-a00ac3658ff5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:14.986069 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3eb10f95-1571-4ef6-8555-a00ac3658ff5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:14.986515 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3eb10f95-1571-4ef6-8555-a00ac3658ff5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:14.987276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3eb10f95-1571-4ef6-8555-a00ac3658ff5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:14.987717 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3eb10f95-1571-4ef6-8555-a00ac3658ff5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:15.049792 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3eb10f95-1571-4ef6-8555-a00ac3658ff5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:15.058575 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3eb10f95-1571-4ef6-8555-a00ac3658ff5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:15.060120 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3eb10f95-1571-4ef6-8555-a00ac3658ff5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:15.061282 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3eb10f95-1571-4ef6-8555-a00ac3658ff5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1278 microversion: 2.20 time: 0.085715 Jul 20 11:38:15.061839 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 189/372] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:14 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:15.073619 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-42854eb8-f948-4d6d-8802-cb76c2bef79e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:15.074275 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-42854eb8-f948-4d6d-8802-cb76c2bef79e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:15.081049 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42854eb8-f948-4d6d-8802-cb76c2bef79e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:15.081561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42854eb8-f948-4d6d-8802-cb76c2bef79e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:15.082338 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42854eb8-f948-4d6d-8802-cb76c2bef79e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:15.082787 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-42854eb8-f948-4d6d-8802-cb76c2bef79e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:15.439531 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a0e7540-a7a2-4f3c-bc77-81437ecf1b53 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:15.440245 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a0e7540-a7a2-4f3c-bc77-81437ecf1b53 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:15.448332 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a0e7540-a7a2-4f3c-bc77-81437ecf1b53 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:15.448953 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a0e7540-a7a2-4f3c-bc77-81437ecf1b53 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:15.449791 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a0e7540-a7a2-4f3c-bc77-81437ecf1b53 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:15.450334 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a0e7540-a7a2-4f3c-bc77-81437ecf1b53 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:15.612031 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-42854eb8-f948-4d6d-8802-cb76c2bef79e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:15.619643 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-42854eb8-f948-4d6d-8802-cb76c2bef79e tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.550862 Jul 20 11:38:15.620299 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 184/373] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:15 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:15.717372 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0a0e7540-a7a2-4f3c-bc77-81437ecf1b53 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:15.718821 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d8e94dd5-463c-4b50-81ad-dabb4175cd48 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:15.719675 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d8e94dd5-463c-4b50-81ad-dabb4175cd48 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:15.725244 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a0e7540-a7a2-4f3c-bc77-81437ecf1b53 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1470 microversion: 2.1 time: 0.289846 Jul 20 11:38:15.735059 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 190/374] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:15 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1470 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:15.737421 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8e94dd5-463c-4b50-81ad-dabb4175cd48 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:15.737872 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8e94dd5-463c-4b50-81ad-dabb4175cd48 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:15.739029 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8e94dd5-463c-4b50-81ad-dabb4175cd48 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:15.739469 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d8e94dd5-463c-4b50-81ad-dabb4175cd48 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:15.873036 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d8e94dd5-463c-4b50-81ad-dabb4175cd48 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:15.879736 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d8e94dd5-463c-4b50-81ad-dabb4175cd48 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.165631 Jul 20 11:38:15.880338 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 185/375] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:15 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:16.079830 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5e687348-00cc-4f85-be96-c59131366b3b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:16.080350 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5e687348-00cc-4f85-be96-c59131366b3b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:16.086336 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e687348-00cc-4f85-be96-c59131366b3b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:16.086782 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e687348-00cc-4f85-be96-c59131366b3b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:16.087544 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e687348-00cc-4f85-be96-c59131366b3b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:16.088632 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e687348-00cc-4f85-be96-c59131366b3b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:16.147510 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e687348-00cc-4f85-be96-c59131366b3b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:16.156295 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e687348-00cc-4f85-be96-c59131366b3b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:16.158009 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e687348-00cc-4f85-be96-c59131366b3b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:16.159106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5e687348-00cc-4f85-be96-c59131366b3b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1334 microversion: 2.20 time: 0.083397 Jul 20 11:38:16.159656 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 191/376] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:16 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1334 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:16.645244 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a63e82f0-05c9-414a-ac4d-0454db5bcf8f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:16.645917 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a63e82f0-05c9-414a-ac4d-0454db5bcf8f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:16.652247 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a63e82f0-05c9-414a-ac4d-0454db5bcf8f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:16.652702 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a63e82f0-05c9-414a-ac4d-0454db5bcf8f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:16.653505 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a63e82f0-05c9-414a-ac4d-0454db5bcf8f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:16.654540 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a63e82f0-05c9-414a-ac4d-0454db5bcf8f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:16.747313 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c8e7b0de-c5a7-436b-9ee6-0f0ccc3fec28 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:16.747313 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c8e7b0de-c5a7-436b-9ee6-0f0ccc3fec28 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:16.750866 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8e7b0de-c5a7-436b-9ee6-0f0ccc3fec28 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:16.751310 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8e7b0de-c5a7-436b-9ee6-0f0ccc3fec28 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:16.752084 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8e7b0de-c5a7-436b-9ee6-0f0ccc3fec28 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:16.752596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8e7b0de-c5a7-436b-9ee6-0f0ccc3fec28 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:17.109799 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a63e82f0-05c9-414a-ac4d-0454db5bcf8f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:17.121207 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a63e82f0-05c9-414a-ac4d-0454db5bcf8f tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.487957 Jul 20 11:38:17.121588 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 186/377] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:16 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:17.135636 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c8e7b0de-c5a7-436b-9ee6-0f0ccc3fec28 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:17.136712 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f32b0a0c-2fa6-481b-bff0-9d44ab723d8e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:17.146207 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f32b0a0c-2fa6-481b-bff0-9d44ab723d8e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:17.146207 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32b0a0c-2fa6-481b-bff0-9d44ab723d8e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:17.146493 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32b0a0c-2fa6-481b-bff0-9d44ab723d8e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:17.147080 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32b0a0c-2fa6-481b-bff0-9d44ab723d8e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:17.149219 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c8e7b0de-c5a7-436b-9ee6-0f0ccc3fec28 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1470 microversion: 2.1 time: 0.406214 Jul 20 11:38:17.150050 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f32b0a0c-2fa6-481b-bff0-9d44ab723d8e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:17.161066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 192/378] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:16 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1470 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:17.177382 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a7698f4c-ce63-4a60-bab7-889f42289587 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:17.184599 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a7698f4c-ce63-4a60-bab7-889f42289587 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:17.187237 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7698f4c-ce63-4a60-bab7-889f42289587 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:17.187689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7698f4c-ce63-4a60-bab7-889f42289587 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:17.188466 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7698f4c-ce63-4a60-bab7-889f42289587 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:17.188946 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7698f4c-ce63-4a60-bab7-889f42289587 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:17.272096 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a7698f4c-ce63-4a60-bab7-889f42289587 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:17.280220 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a7698f4c-ce63-4a60-bab7-889f42289587 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:17.281978 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a7698f4c-ce63-4a60-bab7-889f42289587 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:17.283115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a7698f4c-ce63-4a60-bab7-889f42289587 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1352 microversion: 2.20 time: 0.109665 Jul 20 11:38:17.284064 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 193/379] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:17 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:17.368202 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f32b0a0c-2fa6-481b-bff0-9d44ab723d8e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:17.376723 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f32b0a0c-2fa6-481b-bff0-9d44ab723d8e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.253875 Jul 20 11:38:17.377364 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 187/380] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:17 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:17.506684 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-908957b8-f9a4-44db-a985-663951da3544 req-f944dcd3-ab81-4e10-9b1e-c5b04058a39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77041ff-ede6-4648-99ee-5f97909cbd34", "name": "network-vif-deleted", "tag": "572c845f-f47f-4120-932d-de63220a9c87"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:17.515642 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-908957b8-f9a4-44db-a985-663951da3544 req-f944dcd3-ab81-4e10-9b1e-c5b04058a39e service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:17.516616 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-908957b8-f9a4-44db-a985-663951da3544 req-f944dcd3-ab81-4e10-9b1e-c5b04058a39e service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:17.530257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-908957b8-f9a4-44db-a985-663951da3544 req-f944dcd3-ab81-4e10-9b1e-c5b04058a39e service nova] Creating event network-vif-deleted:572c845f-f47f-4120-932d-de63220a9c87 for instance a77041ff-ede6-4648-99ee-5f97909cbd34 on hv-cinder-82282 Jul 20 11:38:17.539915 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-908957b8-f9a4-44db-a985-663951da3544 req-f944dcd3-ab81-4e10-9b1e-c5b04058a39e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033535 Jul 20 11:38:17.539915 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 194/381] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:18.137715 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-79d26773-80de-45dc-bb60-00aa41692e43 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:18.138300 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-79d26773-80de-45dc-bb60-00aa41692e43 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:18.144705 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79d26773-80de-45dc-bb60-00aa41692e43 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:18.145189 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79d26773-80de-45dc-bb60-00aa41692e43 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:18.145959 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79d26773-80de-45dc-bb60-00aa41692e43 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:18.146396 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-79d26773-80de-45dc-bb60-00aa41692e43 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:18.168476 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fdfb954c-00ee-4c7a-9f30-cba50dedb21e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:18.169205 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fdfb954c-00ee-4c7a-9f30-cba50dedb21e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:18.176395 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdfb954c-00ee-4c7a-9f30-cba50dedb21e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:18.176853 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdfb954c-00ee-4c7a-9f30-cba50dedb21e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:18.177951 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdfb954c-00ee-4c7a-9f30-cba50dedb21e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:18.178541 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdfb954c-00ee-4c7a-9f30-cba50dedb21e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:18.262347 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fdfb954c-00ee-4c7a-9f30-cba50dedb21e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:18.269835 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fdfb954c-00ee-4c7a-9f30-cba50dedb21e tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1428 microversion: 2.1 time: 0.106157 Jul 20 11:38:18.270494 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 195/382] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:18 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1428 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:18.301609 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-761cc3e5-909e-4d41-a82d-deb875474d81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:18.302218 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-761cc3e5-909e-4d41-a82d-deb875474d81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:18.302654 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-79d26773-80de-45dc-bb60-00aa41692e43 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:18.308132 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-761cc3e5-909e-4d41-a82d-deb875474d81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:18.308577 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-761cc3e5-909e-4d41-a82d-deb875474d81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:18.309383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-761cc3e5-909e-4d41-a82d-deb875474d81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:18.309815 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-761cc3e5-909e-4d41-a82d-deb875474d81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:18.310084 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-79d26773-80de-45dc-bb60-00aa41692e43 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.176587 Jul 20 11:38:18.311010 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 188/383] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:18 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:18.394644 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2970be0e-04d5-4e49-adc9-32dbc8d164af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:18.395260 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2970be0e-04d5-4e49-adc9-32dbc8d164af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:18.402015 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2970be0e-04d5-4e49-adc9-32dbc8d164af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:18.402474 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2970be0e-04d5-4e49-adc9-32dbc8d164af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:18.403262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2970be0e-04d5-4e49-adc9-32dbc8d164af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:18.403902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2970be0e-04d5-4e49-adc9-32dbc8d164af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:18.455845 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-761cc3e5-909e-4d41-a82d-deb875474d81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:18.464291 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-761cc3e5-909e-4d41-a82d-deb875474d81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:18.465828 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-761cc3e5-909e-4d41-a82d-deb875474d81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:18.466940 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-761cc3e5-909e-4d41-a82d-deb875474d81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1420 microversion: 2.20 time: 0.169206 Jul 20 11:38:18.467493 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 196/384] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:18 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:38:18.543764 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2970be0e-04d5-4e49-adc9-32dbc8d164af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:18.551311 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2970be0e-04d5-4e49-adc9-32dbc8d164af tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.160583 Jul 20 11:38:18.551878 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 189/385] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:18 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:19.287361 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-637f5570-d8a9-4e1a-a64d-23a4eb3a2e9a tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:19.287998 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-637f5570-d8a9-4e1a-a64d-23a4eb3a2e9a tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:19.294813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-637f5570-d8a9-4e1a-a64d-23a4eb3a2e9a tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:19.295259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-637f5570-d8a9-4e1a-a64d-23a4eb3a2e9a tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:19.296136 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-637f5570-d8a9-4e1a-a64d-23a4eb3a2e9a tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:19.296717 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-637f5570-d8a9-4e1a-a64d-23a4eb3a2e9a tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:19.326493 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d65a1565-6999-457c-867d-cc3de1802a54 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:19.327139 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d65a1565-6999-457c-867d-cc3de1802a54 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:19.333648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d65a1565-6999-457c-867d-cc3de1802a54 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:19.334095 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d65a1565-6999-457c-867d-cc3de1802a54 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:19.334869 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d65a1565-6999-457c-867d-cc3de1802a54 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:19.335302 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d65a1565-6999-457c-867d-cc3de1802a54 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:19.359321 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-637f5570-d8a9-4e1a-a64d-23a4eb3a2e9a tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:19.367065 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-637f5570-d8a9-4e1a-a64d-23a4eb3a2e9a tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1428 microversion: 2.1 time: 0.083474 Jul 20 11:38:19.368023 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 197/386] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:19 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:19.466127 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d65a1565-6999-457c-867d-cc3de1802a54 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:19.473766 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d65a1565-6999-457c-867d-cc3de1802a54 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.151104 Jul 20 11:38:19.474327 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 190/387] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:19 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:19.484832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b15bb903-2980-46b5-b37b-d19a9ced2a8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:19.485447 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b15bb903-2980-46b5-b37b-d19a9ced2a8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:19.491645 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b15bb903-2980-46b5-b37b-d19a9ced2a8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:19.499773 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b15bb903-2980-46b5-b37b-d19a9ced2a8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:19.499773 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b15bb903-2980-46b5-b37b-d19a9ced2a8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:19.499773 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b15bb903-2980-46b5-b37b-d19a9ced2a8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:19.567495 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-64cb7eb3-32d9-49a6-8b2a-7db903ba47e4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:19.568149 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-64cb7eb3-32d9-49a6-8b2a-7db903ba47e4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:19.574923 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64cb7eb3-32d9-49a6-8b2a-7db903ba47e4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:19.575895 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64cb7eb3-32d9-49a6-8b2a-7db903ba47e4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:19.576672 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64cb7eb3-32d9-49a6-8b2a-7db903ba47e4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:19.577138 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64cb7eb3-32d9-49a6-8b2a-7db903ba47e4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:19.638614 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b15bb903-2980-46b5-b37b-d19a9ced2a8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:19.646467 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b15bb903-2980-46b5-b37b-d19a9ced2a8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:19.647969 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b15bb903-2980-46b5-b37b-d19a9ced2a8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:19.649093 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b15bb903-2980-46b5-b37b-d19a9ced2a8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1420 microversion: 2.20 time: 0.168302 Jul 20 11:38:19.649656 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 198/388] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:19 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:19.723061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-64cb7eb3-32d9-49a6-8b2a-7db903ba47e4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:19.732385 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-64cb7eb3-32d9-49a6-8b2a-7db903ba47e4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.168456 Jul 20 11:38:19.733367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 191/389] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:19 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:20.384362 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d1ca2f40-c7a8-4db9-bcd7-16b2471036d5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:20.385036 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d1ca2f40-c7a8-4db9-bcd7-16b2471036d5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:20.391280 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1ca2f40-c7a8-4db9-bcd7-16b2471036d5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:20.391729 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1ca2f40-c7a8-4db9-bcd7-16b2471036d5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:20.392511 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1ca2f40-c7a8-4db9-bcd7-16b2471036d5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:20.392975 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d1ca2f40-c7a8-4db9-bcd7-16b2471036d5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:20.458731 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d1ca2f40-c7a8-4db9-bcd7-16b2471036d5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:20.462189 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:20.467013 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d1ca2f40-c7a8-4db9-bcd7-16b2471036d5 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1428 microversion: 2.1 time: 0.086529 Jul 20 11:38:20.467578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 199/390] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:20 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:20.490614 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1f3f9eb6-df88-4479-b7fb-d1c096784bb7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:20.491224 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1f3f9eb6-df88-4479-b7fb-d1c096784bb7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:20.497675 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f3f9eb6-df88-4479-b7fb-d1c096784bb7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:20.498122 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f3f9eb6-df88-4479-b7fb-d1c096784bb7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:20.498892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f3f9eb6-df88-4479-b7fb-d1c096784bb7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:20.499324 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f3f9eb6-df88-4479-b7fb-d1c096784bb7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:20.627896 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1f3f9eb6-df88-4479-b7fb-d1c096784bb7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:20.635985 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1f3f9eb6-df88-4479-b7fb-d1c096784bb7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.148342 Jul 20 11:38:20.636493 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 192/391] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:20 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:20.667347 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c7c623d1-0996-4aac-a881-bbd5f6525670 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:20.667946 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c7c623d1-0996-4aac-a881-bbd5f6525670 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:20.674023 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7c623d1-0996-4aac-a881-bbd5f6525670 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:20.674464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7c623d1-0996-4aac-a881-bbd5f6525670 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:20.675210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7c623d1-0996-4aac-a881-bbd5f6525670 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:20.675637 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c7c623d1-0996-4aac-a881-bbd5f6525670 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:20.749872 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-424cd976-29a4-47d9-ba9d-c36df9afe329 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:20.750419 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-424cd976-29a4-47d9-ba9d-c36df9afe329 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:20.756381 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-424cd976-29a4-47d9-ba9d-c36df9afe329 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:20.756853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-424cd976-29a4-47d9-ba9d-c36df9afe329 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:20.757617 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-424cd976-29a4-47d9-ba9d-c36df9afe329 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:20.758051 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-424cd976-29a4-47d9-ba9d-c36df9afe329 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:20.812736 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c7c623d1-0996-4aac-a881-bbd5f6525670 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:20.821174 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c7c623d1-0996-4aac-a881-bbd5f6525670 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:20.823340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c7c623d1-0996-4aac-a881-bbd5f6525670 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:20.824552 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c7c623d1-0996-4aac-a881-bbd5f6525670 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1420 microversion: 2.20 time: 0.161500 Jul 20 11:38:20.828733 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 200/392] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:20 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:20.903611 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-424cd976-29a4-47d9-ba9d-c36df9afe329 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:20.911067 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-424cd976-29a4-47d9-ba9d-c36df9afe329 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.165105 Jul 20 11:38:20.911636 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 193/393] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:20 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:21.485538 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a093c002-c723-42fa-a515-66acecbf23ac tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:21.486731 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a093c002-c723-42fa-a515-66acecbf23ac tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:21.499305 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a093c002-c723-42fa-a515-66acecbf23ac tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:21.500038 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a093c002-c723-42fa-a515-66acecbf23ac tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:21.501325 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a093c002-c723-42fa-a515-66acecbf23ac tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:21.502422 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a093c002-c723-42fa-a515-66acecbf23ac tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:21.540032 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a093c002-c723-42fa-a515-66acecbf23ac tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:21.541818 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a093c002-c723-42fa-a515-66acecbf23ac tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:21.542428 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-a093c002-c723-42fa-a515-66acecbf23ac tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lazy-loading 'fault' on Instance uuid a77041ff-ede6-4648-99ee-5f97909cbd34 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:38:21.624507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a093c002-c723-42fa-a515-66acecbf23ac tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:21.624507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a093c002-c723-42fa-a515-66acecbf23ac tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1305 microversion: 2.1 time: 0.118657 Jul 20 11:38:21.624507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 201/394] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:21 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1305 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:21.653018 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e207816-5ad8-4c08-ac18-5c4c05b194e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:21.653774 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2e207816-5ad8-4c08-ac18-5c4c05b194e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:21.670977 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e207816-5ad8-4c08-ac18-5c4c05b194e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:21.671456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e207816-5ad8-4c08-ac18-5c4c05b194e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:21.672252 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e207816-5ad8-4c08-ac18-5c4c05b194e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:21.672692 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e207816-5ad8-4c08-ac18-5c4c05b194e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:21.843028 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b2490670-8f39-499a-a779-23f6fd816080 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:21.843653 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b2490670-8f39-499a-a779-23f6fd816080 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:21.849993 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2490670-8f39-499a-a779-23f6fd816080 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:21.851126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2490670-8f39-499a-a779-23f6fd816080 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:21.852377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2490670-8f39-499a-a779-23f6fd816080 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:21.852993 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2490670-8f39-499a-a779-23f6fd816080 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:21.988711 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2e207816-5ad8-4c08-ac18-5c4c05b194e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:21.996368 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2e207816-5ad8-4c08-ac18-5c4c05b194e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.347413 Jul 20 11:38:22.000339 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 194/395] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:21 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:22.006790 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-46d05750-5066-4b20-8c55-c9a1e45d94c8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:22.007552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-46d05750-5066-4b20-8c55-c9a1e45d94c8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:22.017006 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46d05750-5066-4b20-8c55-c9a1e45d94c8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:22.017818 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46d05750-5066-4b20-8c55-c9a1e45d94c8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:22.019575 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46d05750-5066-4b20-8c55-c9a1e45d94c8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:22.020307 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-46d05750-5066-4b20-8c55-c9a1e45d94c8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:22.091606 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2490670-8f39-499a-a779-23f6fd816080 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:22.101424 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2490670-8f39-499a-a779-23f6fd816080 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:22.103350 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2490670-8f39-499a-a779-23f6fd816080 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:22.105361 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b2490670-8f39-499a-a779-23f6fd816080 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.266092 Jul 20 11:38:22.106085 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 202/396] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:21 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:38:22.180183 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-46d05750-5066-4b20-8c55-c9a1e45d94c8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:22.188307 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-46d05750-5066-4b20-8c55-c9a1e45d94c8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.186913 Jul 20 11:38:22.188897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 195/397] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:22 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:22.616631 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0bae532f-bbaa-4aff-951e-8afefff0fa12 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:22.617392 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0bae532f-bbaa-4aff-951e-8afefff0fa12 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:22.624930 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bae532f-bbaa-4aff-951e-8afefff0fa12 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:22.625761 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bae532f-bbaa-4aff-951e-8afefff0fa12 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:22.627257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bae532f-bbaa-4aff-951e-8afefff0fa12 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:22.628043 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bae532f-bbaa-4aff-951e-8afefff0fa12 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:22.650200 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-8943247a-1518-4b4b-8919-880aabc16fc2 req-66b91e60-0697-4b34-8dd3-faa6332c7845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea3abfd3-22be-4728-9006-19ad38c1bd9c", "tag": "e605e30c-d865-4978-9798-9dc53408552e"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:22.660285 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-8943247a-1518-4b4b-8919-880aabc16fc2 req-66b91e60-0697-4b34-8dd3-faa6332c7845 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:22.660920 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-8943247a-1518-4b4b-8919-880aabc16fc2 req-66b91e60-0697-4b34-8dd3-faa6332c7845 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:22.664239 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bae532f-bbaa-4aff-951e-8afefff0fa12 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:22.664684 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0bae532f-bbaa-4aff-951e-8afefff0fa12 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:22.665158 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-0bae532f-bbaa-4aff-951e-8afefff0fa12 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lazy-loading 'fault' on Instance uuid a77041ff-ede6-4648-99ee-5f97909cbd34 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:38:22.682663 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-8943247a-1518-4b4b-8919-880aabc16fc2 req-66b91e60-0697-4b34-8dd3-faa6332c7845 service nova] Creating event network-changed:e605e30c-d865-4978-9798-9dc53408552e for instance ea3abfd3-22be-4728-9006-19ad38c1bd9c on hv-cinder-82282 Jul 20 11:38:22.687987 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-8943247a-1518-4b4b-8919-880aabc16fc2 req-66b91e60-0697-4b34-8dd3-faa6332c7845 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041730 Jul 20 11:38:22.688593 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 196/398] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:22.706527 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0bae532f-bbaa-4aff-951e-8afefff0fa12 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:22.715038 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0bae532f-bbaa-4aff-951e-8afefff0fa12 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1305 microversion: 2.1 time: 0.103153 Jul 20 11:38:22.715782 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 203/399] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:22 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:23.016915 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ac716601-e60a-41c2-b8a5-e22d298e5b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:23.017630 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ac716601-e60a-41c2-b8a5-e22d298e5b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:23.023822 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac716601-e60a-41c2-b8a5-e22d298e5b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:23.024261 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac716601-e60a-41c2-b8a5-e22d298e5b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:23.025067 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac716601-e60a-41c2-b8a5-e22d298e5b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:23.025500 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac716601-e60a-41c2-b8a5-e22d298e5b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:23.029596 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:23.125459 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-37b049c1-5105-45a4-b1c2-5a2ad16abe04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:23.125977 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-37b049c1-5105-45a4-b1c2-5a2ad16abe04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:23.131887 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37b049c1-5105-45a4-b1c2-5a2ad16abe04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:23.132325 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37b049c1-5105-45a4-b1c2-5a2ad16abe04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:23.133113 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37b049c1-5105-45a4-b1c2-5a2ad16abe04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:23.133542 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-37b049c1-5105-45a4-b1c2-5a2ad16abe04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:23.165655 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ac716601-e60a-41c2-b8a5-e22d298e5b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:23.174174 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ac716601-e60a-41c2-b8a5-e22d298e5b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.161422 Jul 20 11:38:23.174761 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 197/400] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:23 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:23.204524 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1da354a6-ee40-4645-8020-e08ff81d3206 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:23.205309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1da354a6-ee40-4645-8020-e08ff81d3206 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:23.211483 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1da354a6-ee40-4645-8020-e08ff81d3206 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:23.212347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1da354a6-ee40-4645-8020-e08ff81d3206 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:23.213790 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1da354a6-ee40-4645-8020-e08ff81d3206 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:23.214309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1da354a6-ee40-4645-8020-e08ff81d3206 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:23.317957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37b049c1-5105-45a4-b1c2-5a2ad16abe04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:23.327208 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37b049c1-5105-45a4-b1c2-5a2ad16abe04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:23.328724 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-37b049c1-5105-45a4-b1c2-5a2ad16abe04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:23.329872 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-37b049c1-5105-45a4-b1c2-5a2ad16abe04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.208285 Jul 20 11:38:23.330435 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 204/401] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:23 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:38:23.367540 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1da354a6-ee40-4645-8020-e08ff81d3206 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:23.374985 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1da354a6-ee40-4645-8020-e08ff81d3206 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.174465 Jul 20 11:38:23.375612 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 198/402] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:23 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:23.733591 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ed26e04d-ff1f-498d-a67d-f48cd68ecb1d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:23.734197 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ed26e04d-ff1f-498d-a67d-f48cd68ecb1d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:23.740142 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed26e04d-ff1f-498d-a67d-f48cd68ecb1d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:23.740584 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed26e04d-ff1f-498d-a67d-f48cd68ecb1d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:23.741382 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed26e04d-ff1f-498d-a67d-f48cd68ecb1d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:23.741816 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed26e04d-ff1f-498d-a67d-f48cd68ecb1d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:23.773275 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed26e04d-ff1f-498d-a67d-f48cd68ecb1d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:23.773719 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed26e04d-ff1f-498d-a67d-f48cd68ecb1d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:23.774157 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-ed26e04d-ff1f-498d-a67d-f48cd68ecb1d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lazy-loading 'fault' on Instance uuid a77041ff-ede6-4648-99ee-5f97909cbd34 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:38:23.814148 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ed26e04d-ff1f-498d-a67d-f48cd68ecb1d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:23.821335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ed26e04d-ff1f-498d-a67d-f48cd68ecb1d tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1305 microversion: 2.1 time: 0.091657 Jul 20 11:38:23.821897 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 205/403] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:23 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:24.191383 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-710cb9b2-986a-4e95-b233-a726559aa505 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:24.192069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-710cb9b2-986a-4e95-b233-a726559aa505 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:24.199155 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-710cb9b2-986a-4e95-b233-a726559aa505 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:24.199595 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-710cb9b2-986a-4e95-b233-a726559aa505 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:24.200351 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-710cb9b2-986a-4e95-b233-a726559aa505 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:24.200800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-710cb9b2-986a-4e95-b233-a726559aa505 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:24.334166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-710cb9b2-986a-4e95-b233-a726559aa505 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:24.341462 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-710cb9b2-986a-4e95-b233-a726559aa505 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.154015 Jul 20 11:38:24.342026 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 199/404] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:24 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:24.347630 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bd7dc5e9-31d5-4c71-8402-85f977144901 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:24.348314 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bd7dc5e9-31d5-4c71-8402-85f977144901 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:24.354864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd7dc5e9-31d5-4c71-8402-85f977144901 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:24.355306 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd7dc5e9-31d5-4c71-8402-85f977144901 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:24.356066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd7dc5e9-31d5-4c71-8402-85f977144901 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:24.356499 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd7dc5e9-31d5-4c71-8402-85f977144901 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:24.391612 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-24891f60-2e23-4f33-8f98-e63b981529dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:24.392213 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-24891f60-2e23-4f33-8f98-e63b981529dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:24.394049 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:24.398877 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24891f60-2e23-4f33-8f98-e63b981529dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:24.399371 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24891f60-2e23-4f33-8f98-e63b981529dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:24.400444 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24891f60-2e23-4f33-8f98-e63b981529dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:24.400974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-24891f60-2e23-4f33-8f98-e63b981529dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:24.538032 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bd7dc5e9-31d5-4c71-8402-85f977144901 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:24.546843 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bd7dc5e9-31d5-4c71-8402-85f977144901 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:24.548351 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bd7dc5e9-31d5-4c71-8402-85f977144901 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:24.549491 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bd7dc5e9-31d5-4c71-8402-85f977144901 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.205772 Jul 20 11:38:24.550043 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 206/405] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:24 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:38:24.568397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-24891f60-2e23-4f33-8f98-e63b981529dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:24.577627 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-24891f60-2e23-4f33-8f98-e63b981529dd tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.189666 Jul 20 11:38:24.578387 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 200/406] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:24 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:24.837032 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8a76e2dc-16ce-4212-8f0d-3da073dcd919 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:24.837660 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8a76e2dc-16ce-4212-8f0d-3da073dcd919 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:24.840059 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:24.844731 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a76e2dc-16ce-4212-8f0d-3da073dcd919 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:24.851900 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a76e2dc-16ce-4212-8f0d-3da073dcd919 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:24.851900 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a76e2dc-16ce-4212-8f0d-3da073dcd919 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:24.851900 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a76e2dc-16ce-4212-8f0d-3da073dcd919 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:24.884212 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a76e2dc-16ce-4212-8f0d-3da073dcd919 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:24.884661 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8a76e2dc-16ce-4212-8f0d-3da073dcd919 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:24.885154 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-8a76e2dc-16ce-4212-8f0d-3da073dcd919 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lazy-loading 'fault' on Instance uuid a77041ff-ede6-4648-99ee-5f97909cbd34 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:38:24.965035 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8a76e2dc-16ce-4212-8f0d-3da073dcd919 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:24.973256 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8a76e2dc-16ce-4212-8f0d-3da073dcd919 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1305 microversion: 2.1 time: 0.139892 Jul 20 11:38:24.973842 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 207/407] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:24 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1305 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:25.169124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-90dfff09-db00-4f3c-9839-d259e1efa2d8 req-89775020-36ab-4718-9faf-951488b43e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ace499-ddc8-4a47-8e3d-730594d57bfa", "name": "network-vif-plugged", "status": "completed", "tag": "7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:25.179552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-90dfff09-db00-4f3c-9839-d259e1efa2d8 req-89775020-36ab-4718-9faf-951488b43e02 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:25.179997 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-90dfff09-db00-4f3c-9839-d259e1efa2d8 req-89775020-36ab-4718-9faf-951488b43e02 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:25.199419 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-90dfff09-db00-4f3c-9839-d259e1efa2d8 req-89775020-36ab-4718-9faf-951488b43e02 service nova] Creating event network-vif-plugged:7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe for instance d0ace499-ddc8-4a47-8e3d-730594d57bfa on hv-cinder-82282 Jul 20 11:38:25.230334 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-90dfff09-db00-4f3c-9839-d259e1efa2d8 req-89775020-36ab-4718-9faf-951488b43e02 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066082 Jul 20 11:38:25.232053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 201/408] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:25.358449 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c085cf16-6e21-4cf6-8fcf-d6fd0d1d42d1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:25.359258 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c085cf16-6e21-4cf6-8fcf-d6fd0d1d42d1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:25.365944 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c085cf16-6e21-4cf6-8fcf-d6fd0d1d42d1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:25.366548 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c085cf16-6e21-4cf6-8fcf-d6fd0d1d42d1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:25.367388 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c085cf16-6e21-4cf6-8fcf-d6fd0d1d42d1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:25.368602 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c085cf16-6e21-4cf6-8fcf-d6fd0d1d42d1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:25.502059 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c085cf16-6e21-4cf6-8fcf-d6fd0d1d42d1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:25.509448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c085cf16-6e21-4cf6-8fcf-d6fd0d1d42d1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.154912 Jul 20 11:38:25.510055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 208/409] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:25 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:25.568117 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bcc4f9d1-38dd-4fd8-bb11-c96ebc54245d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:25.568802 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bcc4f9d1-38dd-4fd8-bb11-c96ebc54245d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:25.575583 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bcc4f9d1-38dd-4fd8-bb11-c96ebc54245d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:25.576032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bcc4f9d1-38dd-4fd8-bb11-c96ebc54245d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:25.576806 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bcc4f9d1-38dd-4fd8-bb11-c96ebc54245d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:25.577247 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bcc4f9d1-38dd-4fd8-bb11-c96ebc54245d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:25.594593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e7cf575b-142b-46cd-9271-ac9e79dea292 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:25.595197 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e7cf575b-142b-46cd-9271-ac9e79dea292 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:25.601416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7cf575b-142b-46cd-9271-ac9e79dea292 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:25.601888 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7cf575b-142b-46cd-9271-ac9e79dea292 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:25.602687 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7cf575b-142b-46cd-9271-ac9e79dea292 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:25.603184 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e7cf575b-142b-46cd-9271-ac9e79dea292 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:25.783143 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bcc4f9d1-38dd-4fd8-bb11-c96ebc54245d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:25.787581 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e7cf575b-142b-46cd-9271-ac9e79dea292 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:25.791740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bcc4f9d1-38dd-4fd8-bb11-c96ebc54245d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:25.793312 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bcc4f9d1-38dd-4fd8-bb11-c96ebc54245d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:25.794413 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bcc4f9d1-38dd-4fd8-bb11-c96ebc54245d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.230739 Jul 20 11:38:25.794969 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 202/410] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:25 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:25.795841 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e7cf575b-142b-46cd-9271-ac9e79dea292 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1510 microversion: 2.1 time: 0.205064 Jul 20 11:38:25.796436 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 209/411] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:25 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:25.990736 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b588a21-2484-43be-8fa2-f97e30a99064 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:25.991370 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b588a21-2484-43be-8fa2-f97e30a99064 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:25.998005 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b588a21-2484-43be-8fa2-f97e30a99064 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:25.998446 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b588a21-2484-43be-8fa2-f97e30a99064 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:25.999202 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b588a21-2484-43be-8fa2-f97e30a99064 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:25.999637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b588a21-2484-43be-8fa2-f97e30a99064 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:26.029839 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b588a21-2484-43be-8fa2-f97e30a99064 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:26.030284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b588a21-2484-43be-8fa2-f97e30a99064 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:26.030731 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-5b588a21-2484-43be-8fa2-f97e30a99064 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lazy-loading 'fault' on Instance uuid a77041ff-ede6-4648-99ee-5f97909cbd34 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:38:26.078915 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5b588a21-2484-43be-8fa2-f97e30a99064 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcda2838d94fcd93e37a5b40e27c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5547e6a8728407bae158f8824dc6243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:26.086782 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b588a21-2484-43be-8fa2-f97e30a99064 tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 200 len: 1305 microversion: 2.1 time: 0.099904 Jul 20 11:38:26.087357 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 203/412] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:25 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:26.528705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-43ef5ade-462a-4e95-93a1-471bdb8f0dcc tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:26.529496 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-43ef5ade-462a-4e95-93a1-471bdb8f0dcc tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:26.535594 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43ef5ade-462a-4e95-93a1-471bdb8f0dcc tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:26.536026 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43ef5ade-462a-4e95-93a1-471bdb8f0dcc tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:26.536936 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43ef5ade-462a-4e95-93a1-471bdb8f0dcc tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:26.537373 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43ef5ade-462a-4e95-93a1-471bdb8f0dcc tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:26.662751 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-43ef5ade-462a-4e95-93a1-471bdb8f0dcc tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:26.670670 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-43ef5ade-462a-4e95-93a1-471bdb8f0dcc tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.145840 Jul 20 11:38:26.671259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 210/413] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:26 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:26.812916 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c1f1141d-57b2-4455-811a-6297cd3d575a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:26.813532 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c1f1141d-57b2-4455-811a-6297cd3d575a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:26.818175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f02b750a-9816-47f4-a204-d4dbd49fad04 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:26.818783 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f02b750a-9816-47f4-a204-d4dbd49fad04 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:26.819975 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1f1141d-57b2-4455-811a-6297cd3d575a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:26.820426 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1f1141d-57b2-4455-811a-6297cd3d575a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:26.821232 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1f1141d-57b2-4455-811a-6297cd3d575a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:26.821673 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1f1141d-57b2-4455-811a-6297cd3d575a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:26.824644 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f02b750a-9816-47f4-a204-d4dbd49fad04 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:26.825121 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f02b750a-9816-47f4-a204-d4dbd49fad04 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:26.825890 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f02b750a-9816-47f4-a204-d4dbd49fad04 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:26.826323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f02b750a-9816-47f4-a204-d4dbd49fad04 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:27.052305 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c1f1141d-57b2-4455-811a-6297cd3d575a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:27.057315 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f02b750a-9816-47f4-a204-d4dbd49fad04 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:27.061290 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c1f1141d-57b2-4455-811a-6297cd3d575a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:27.062999 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c1f1141d-57b2-4455-811a-6297cd3d575a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:27.064108 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c1f1141d-57b2-4455-811a-6297cd3d575a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.255081 Jul 20 11:38:27.065290 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f02b750a-9816-47f4-a204-d4dbd49fad04 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1516 microversion: 2.1 time: 0.250807 Jul 20 11:38:27.066115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 211/414] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:26 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1516 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:27.071674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 204/415] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:26 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:27.103267 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ce05c73b-a783-40ed-a3c4-07817ad6dfae tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:27.104678 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ce05c73b-a783-40ed-a3c4-07817ad6dfae tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] [instance: a77041ff-ede6-4648-99ee-5f97909cbd34] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:27.111582 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce05c73b-a783-40ed-a3c4-07817ad6dfae tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:27.112106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce05c73b-a783-40ed-a3c4-07817ad6dfae tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:27.113872 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce05c73b-a783-40ed-a3c4-07817ad6dfae tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:27.113872 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce05c73b-a783-40ed-a3c4-07817ad6dfae tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:27.130206 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-ce05c73b-a783-40ed-a3c4-07817ad6dfae tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] HTTP exception thrown: Instance a77041ff-ede6-4648-99ee-5f97909cbd34 could not be found. Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ce05c73b-a783-40ed-a3c4-07817ad6dfae tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Request method failure captured: Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 HTTP/1.1 Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-j5H0pKurgSRYdfbKGHtmER0vRktCKbqBrBx9tVVDPDbNgzJqW1S3qLigXsoLMiw_Wc8vDIDz7MRYGA3y7VP5MnPk30z45QSVJQVegYNrKgrNh1rNlw5Yil2FbTK9nscx1UA-0RwAkkjw0EX3EkzlWjZQpglv9-yEm36wo1VjaZmdE Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: c5547e6a8728407bae158f8824dc6243 Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesNegativeTest-840331664 Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:38:27.131965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:38:27.134277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5547e6a8728407bae158f8824dc6243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5547e6a8728407bae158f8824dc6243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5547e6a8728407bae158f8824dc6243", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5547e6a8728407bae158f8824dc6243"}]}] Jul 20 11:38:27.134277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesNegativeTest-840331664 Jul 20 11:38:27.134277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: c5547e6a8728407bae158f8824dc6243 Jul 20 11:38:27.134277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesNegativeTest-840331664 Jul 20 11:38:27.134277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesNegativeTest-840331664-project Jul 20 11:38:27.134277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:38:27.134277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:38:27.134277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: befcda2838d94fcd93e37a5b40e27c52 Jul 20 11:38:27.134277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesNegativeTest-840331664-project Jul 20 11:38:27.134277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:38:27.134277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance a77041ff-ede6-4648-99ee-5f97909cbd34 could not be found. Jul 20 11:38:27.134277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'a77041ff-ede6-4648-99ee-5f97909cbd34'} Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a77041ff-ede6-4648-99ee-5f97909cbd34 could not be found. Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:38:27.135167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a77041ff-ede6-4648-99ee-5f97909cbd34 could not be found. Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a77041ff-ede6-4648-99ee-5f97909cbd34 could not be found. Jul 20 11:38:27.136629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:38:27.137796 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ce05c73b-a783-40ed-a3c4-07817ad6dfae tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] Returning 404 to user: Instance a77041ff-ede6-4648-99ee-5f97909cbd34 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:38:27.137796 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ce05c73b-a783-40ed-a3c4-07817ad6dfae tempest-VolumesNegativeTest-840331664 tempest-VolumesNegativeTest-840331664-project] 10.222.0.43 "GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34" status: 404 len: 111 microversion: 2.1 time: 0.034032 Jul 20 11:38:27.137796 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 212/416] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:27 2022] GET /compute/v2.1/servers/a77041ff-ede6-4648-99ee-5f97909cbd34 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:38:27.689057 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9ab1bcf5-5441-4753-95f6-f86124397ff7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:27.689672 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9ab1bcf5-5441-4753-95f6-f86124397ff7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:27.695665 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ab1bcf5-5441-4753-95f6-f86124397ff7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:27.696119 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ab1bcf5-5441-4753-95f6-f86124397ff7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:27.696913 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ab1bcf5-5441-4753-95f6-f86124397ff7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:27.697351 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ab1bcf5-5441-4753-95f6-f86124397ff7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:27.867715 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9ab1bcf5-5441-4753-95f6-f86124397ff7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:27.876144 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9ab1bcf5-5441-4753-95f6-f86124397ff7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1358 microversion: 2.1 time: 0.190955 Jul 20 11:38:27.882739 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 205/417] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:27 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:28.084947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a1909994-21e7-483b-b21e-867db3d42b1d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:28.085556 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a1909994-21e7-483b-b21e-867db3d42b1d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:28.091869 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1909994-21e7-483b-b21e-867db3d42b1d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:28.092317 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1909994-21e7-483b-b21e-867db3d42b1d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:28.093127 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1909994-21e7-483b-b21e-867db3d42b1d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:28.093560 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a1909994-21e7-483b-b21e-867db3d42b1d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:28.246294 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a1909994-21e7-483b-b21e-867db3d42b1d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:28.254313 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a1909994-21e7-483b-b21e-867db3d42b1d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:28.255964 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a1909994-21e7-483b-b21e-867db3d42b1d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:28.259812 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a1909994-21e7-483b-b21e-867db3d42b1d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.176576 Jul 20 11:38:28.259812 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 213/418] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:28 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:28.893674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a12c7ca8-f0e0-4bae-b8f2-19de20d01356 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:28.894307 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a12c7ca8-f0e0-4bae-b8f2-19de20d01356 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:28.901117 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a12c7ca8-f0e0-4bae-b8f2-19de20d01356 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:28.907492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a12c7ca8-f0e0-4bae-b8f2-19de20d01356 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:28.907492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a12c7ca8-f0e0-4bae-b8f2-19de20d01356 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:28.907492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a12c7ca8-f0e0-4bae-b8f2-19de20d01356 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:29.132811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a12c7ca8-f0e0-4bae-b8f2-19de20d01356 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:29.140757 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a12c7ca8-f0e0-4bae-b8f2-19de20d01356 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1549 microversion: 2.1 time: 0.251159 Jul 20 11:38:29.141354 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 206/419] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:28 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1549 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:29.162022 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c2b14588-1001-433d-bb7d-1eec19f988e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:29.162635 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c2b14588-1001-433d-bb7d-1eec19f988e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:29.169672 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2b14588-1001-433d-bb7d-1eec19f988e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:29.170028 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2b14588-1001-433d-bb7d-1eec19f988e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:29.170796 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2b14588-1001-433d-bb7d-1eec19f988e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:29.171229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2b14588-1001-433d-bb7d-1eec19f988e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:29.276456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-238bfd94-64df-4520-a662-8d15d7384ddf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:29.277548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-238bfd94-64df-4520-a662-8d15d7384ddf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:29.288619 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-238bfd94-64df-4520-a662-8d15d7384ddf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:29.289164 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-238bfd94-64df-4520-a662-8d15d7384ddf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:29.290150 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-238bfd94-64df-4520-a662-8d15d7384ddf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:29.291181 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-238bfd94-64df-4520-a662-8d15d7384ddf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:29.310593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c2b14588-1001-433d-bb7d-1eec19f988e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:29.318220 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c2b14588-1001-433d-bb7d-1eec19f988e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1549 microversion: 2.1 time: 0.163889 Jul 20 11:38:29.319451 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 214/420] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:29 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:29.334492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2fed8980-3be4-483c-a3ed-7e6f00c76018 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:29.338003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2fed8980-3be4-483c-a3ed-7e6f00c76018 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:29.339305 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2fed8980-3be4-483c-a3ed-7e6f00c76018 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Searching by: {'deleted': False, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c'} {{(pid=124831) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:38:29.346009 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fed8980-3be4-483c-a3ed-7e6f00c76018 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:29.350078 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fed8980-3be4-483c-a3ed-7e6f00c76018 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:29.350078 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fed8980-3be4-483c-a3ed-7e6f00c76018 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:29.350078 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2fed8980-3be4-483c-a3ed-7e6f00c76018 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:29.445612 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.multi_cell_list [None req-2fed8980-3be4-483c-a3ed-7e6f00c76018 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 11:38:29.499785 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:29.517153 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-238bfd94-64df-4520-a662-8d15d7384ddf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:29.529863 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-238bfd94-64df-4520-a662-8d15d7384ddf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:29.531448 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-238bfd94-64df-4520-a662-8d15d7384ddf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:29.532558 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-238bfd94-64df-4520-a662-8d15d7384ddf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.261037 Jul 20 11:38:29.533261 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 207/421] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:29 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:38:29.565505 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2fed8980-3be4-483c-a3ed-7e6f00c76018 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.234704 Jul 20 11:38:29.566094 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 215/422] 10.222.0.43 () {58 vars in 1124 bytes} [Wed Jul 20 11:38:29 2022] GET /compute/v2.1/servers => generated 342 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:38:29.577025 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-777e084c-42fe-4edd-9ad1-a041fd4e9a48 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:29.577707 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-777e084c-42fe-4edd-9ad1-a041fd4e9a48 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:29.584569 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-777e084c-42fe-4edd-9ad1-a041fd4e9a48 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:29.585042 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-777e084c-42fe-4edd-9ad1-a041fd4e9a48 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:29.585803 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-777e084c-42fe-4edd-9ad1-a041fd4e9a48 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:29.586369 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-777e084c-42fe-4edd-9ad1-a041fd4e9a48 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:29.726472 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-777e084c-42fe-4edd-9ad1-a041fd4e9a48 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:29.734497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-777e084c-42fe-4edd-9ad1-a041fd4e9a48 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1549 microversion: 2.1 time: 0.161659 Jul 20 11:38:29.735142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 208/423] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:29 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:30.551598 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7381691f-edd3-4828-ba7e-754c8fdabf95 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:30.552292 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7381691f-edd3-4828-ba7e-754c8fdabf95 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:30.558944 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7381691f-edd3-4828-ba7e-754c8fdabf95 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:30.559619 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7381691f-edd3-4828-ba7e-754c8fdabf95 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:30.560496 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7381691f-edd3-4828-ba7e-754c8fdabf95 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:30.561045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7381691f-edd3-4828-ba7e-754c8fdabf95 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:30.712017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7381691f-edd3-4828-ba7e-754c8fdabf95 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:30.723048 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7381691f-edd3-4828-ba7e-754c8fdabf95 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:30.725888 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7381691f-edd3-4828-ba7e-754c8fdabf95 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:30.729025 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7381691f-edd3-4828-ba7e-754c8fdabf95 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.179748 Jul 20 11:38:30.729608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 216/424] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:30 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:30.769567 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-398c7ebc-823b-4092-bb7a-555bb7be8047 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Action: 'create', calling method: .version_select at 0x7f44e026e9d0>, body: {"keypair": {"name": "tempest-keypair-313792322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCMstU4KQefuprc1EsJLw5wPtJ6XhOyKx3TI64rPaKT2B4FVoEkhmmBEZ/rry0QxAfHJWrAtfsbE0cI0lIUb73xrelQQgF84WW0ElNw8cMqVcnFzZouq4G2jH/24NpZ2Q=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:30.783956 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-398c7ebc-823b-4092-bb7a-555bb7be8047 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Getting quotas for project 9192fe06f92b47cfbc286bb76e97410b. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:38:30.787699 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-398c7ebc-823b-4092-bb7a-555bb7be8047 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Getting quotas for user 51876164aea741cc873ba4755e6c6fcd and project 9192fe06f92b47cfbc286bb76e97410b. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:38:30.871800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-398c7ebc-823b-4092-bb7a-555bb7be8047 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106050 Jul 20 11:38:30.872477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 209/425] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 11:38:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:31.746527 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b530661a-c7b6-4a8d-8344-21dd7f86fa6f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:31.747122 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b530661a-c7b6-4a8d-8344-21dd7f86fa6f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:31.753106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b530661a-c7b6-4a8d-8344-21dd7f86fa6f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:31.753549 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b530661a-c7b6-4a8d-8344-21dd7f86fa6f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:31.756558 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b530661a-c7b6-4a8d-8344-21dd7f86fa6f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:31.756558 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b530661a-c7b6-4a8d-8344-21dd7f86fa6f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:31.895811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b530661a-c7b6-4a8d-8344-21dd7f86fa6f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:31.905416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b530661a-c7b6-4a8d-8344-21dd7f86fa6f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:31.906952 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b530661a-c7b6-4a8d-8344-21dd7f86fa6f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:31.908083 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b530661a-c7b6-4a8d-8344-21dd7f86fa6f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.165430 Jul 20 11:38:31.908892 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 217/426] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:31 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:32.686974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-15430437-f5a0-4d94-b29c-4d6eceab0595 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "489f702a-c7cf-42e1-ad3c-7b0fd7db34e8"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:32.688134 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-15430437-f5a0-4d94-b29c-4d6eceab0595 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:32.694157 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15430437-f5a0-4d94-b29c-4d6eceab0595 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:32.694605 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15430437-f5a0-4d94-b29c-4d6eceab0595 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:32.695362 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15430437-f5a0-4d94-b29c-4d6eceab0595 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:32.695859 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15430437-f5a0-4d94-b29c-4d6eceab0595 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:32.926223 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-de5dee69-279b-4ba5-a0f0-3dc48375c71f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:32.926830 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-de5dee69-279b-4ba5-a0f0-3dc48375c71f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:32.933210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de5dee69-279b-4ba5-a0f0-3dc48375c71f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:32.934045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de5dee69-279b-4ba5-a0f0-3dc48375c71f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:32.934415 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de5dee69-279b-4ba5-a0f0-3dc48375c71f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:32.934931 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de5dee69-279b-4ba5-a0f0-3dc48375c71f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:33.064038 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de5dee69-279b-4ba5-a0f0-3dc48375c71f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:33.071981 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de5dee69-279b-4ba5-a0f0-3dc48375c71f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:33.073554 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de5dee69-279b-4ba5-a0f0-3dc48375c71f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:33.074650 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-de5dee69-279b-4ba5-a0f0-3dc48375c71f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.152288 Jul 20 11:38:33.075949 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 218/427] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:32 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:38:33.081763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-543389975", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "992b70eb-8a72-41d6-bb82-4697065dd2d5"}], "security_groups": [{"name": "tempest-securitygroup--1079141376"}], "key_name": "tempest-keypair-313792322", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:33.182959 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] validate_networks() for [('992b70eb-8a72-41d6-bb82-4697065dd2d5', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:38:33.546426 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:38:33.546847 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:38:33.547308 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:38:33.548369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:38:33.548369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:38:33.556875 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:33.557319 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:33.558154 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:33.558588 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:33.575422 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Getting quotas for project 9192fe06f92b47cfbc286bb76e97410b. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:38:33.579324 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Getting quotas for user 51876164aea741cc873ba4755e6c6fcd and project 9192fe06f92b47cfbc286bb76e97410b. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:38:33.591061 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:38:33.593456 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:38:33.769300 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7b89ee58-63c7-44b3-be87-e97e2e1f7d72 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.692075 Jul 20 11:38:33.770068 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 219/428] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:38:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:38:33.779820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c511eef-095c-4d6d-bd99-ce3e945d4931 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:33.780425 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8c511eef-095c-4d6d-bd99-ce3e945d4931 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:33.836359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8c511eef-095c-4d6d-bd99-ce3e945d4931 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:33.844052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8c511eef-095c-4d6d-bd99-ce3e945d4931 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1244 microversion: 2.1 time: 0.067871 Jul 20 11:38:33.844614 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 220/429] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:33 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1244 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:34.092988 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dad69a7c-ea30-489f-97be-62c45245a39e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:34.093846 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dad69a7c-ea30-489f-97be-62c45245a39e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:34.102417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dad69a7c-ea30-489f-97be-62c45245a39e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:34.102867 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dad69a7c-ea30-489f-97be-62c45245a39e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:34.103678 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dad69a7c-ea30-489f-97be-62c45245a39e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:34.104114 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dad69a7c-ea30-489f-97be-62c45245a39e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:34.245717 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dad69a7c-ea30-489f-97be-62c45245a39e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:34.255684 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dad69a7c-ea30-489f-97be-62c45245a39e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:34.257336 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dad69a7c-ea30-489f-97be-62c45245a39e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:34.258562 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dad69a7c-ea30-489f-97be-62c45245a39e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.170001 Jul 20 11:38:34.259252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 221/430] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:34 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:38:34.691047 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-15430437-f5a0-4d94-b29c-4d6eceab0595 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "POST /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.009115 Jul 20 11:38:34.697239 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 210/431] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:38:32 2022] POST /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/os-volume_attachments => generated 194 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:34.861986 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-76b0fa06-b76c-40a6-9e7e-09c8a6284340 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:34.862647 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-76b0fa06-b76c-40a6-9e7e-09c8a6284340 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:34.871343 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76b0fa06-b76c-40a6-9e7e-09c8a6284340 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:34.871963 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76b0fa06-b76c-40a6-9e7e-09c8a6284340 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:34.872823 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76b0fa06-b76c-40a6-9e7e-09c8a6284340 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:34.873356 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-76b0fa06-b76c-40a6-9e7e-09c8a6284340 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:34.956662 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-76b0fa06-b76c-40a6-9e7e-09c8a6284340 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:34.966358 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-76b0fa06-b76c-40a6-9e7e-09c8a6284340 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1248 microversion: 2.1 time: 0.108709 Jul 20 11:38:34.967048 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 222/432] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:34 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1248 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:35.279084 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6bd1bc08-ed94-4816-818e-aa4bc04040ba tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:35.279814 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6bd1bc08-ed94-4816-818e-aa4bc04040ba tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:35.286067 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bd1bc08-ed94-4816-818e-aa4bc04040ba tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:35.286514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bd1bc08-ed94-4816-818e-aa4bc04040ba tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:35.287284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bd1bc08-ed94-4816-818e-aa4bc04040ba tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:35.287720 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6bd1bc08-ed94-4816-818e-aa4bc04040ba tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:35.427815 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6bd1bc08-ed94-4816-818e-aa4bc04040ba tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:35.436014 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6bd1bc08-ed94-4816-818e-aa4bc04040ba tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:35.437591 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6bd1bc08-ed94-4816-818e-aa4bc04040ba tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:35.438685 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6bd1bc08-ed94-4816-818e-aa4bc04040ba tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.164896 Jul 20 11:38:35.439241 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 211/433] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:35 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:35.983559 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b1d1fa47-e793-495f-878a-4b0e9e867540 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:35.986319 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b1d1fa47-e793-495f-878a-4b0e9e867540 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:35.993630 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1d1fa47-e793-495f-878a-4b0e9e867540 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:35.994308 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1d1fa47-e793-495f-878a-4b0e9e867540 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:35.995748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1d1fa47-e793-495f-878a-4b0e9e867540 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:35.996628 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1d1fa47-e793-495f-878a-4b0e9e867540 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:36.092879 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1d1fa47-e793-495f-878a-4b0e9e867540 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:36.105401 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b1d1fa47-e793-495f-878a-4b0e9e867540 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1296 microversion: 2.1 time: 0.126272 Jul 20 11:38:36.106400 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 223/434] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:35 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1296 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:36.456937 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f974a3c2-7b95-402c-a23d-ea9e742e852f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:36.457547 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f974a3c2-7b95-402c-a23d-ea9e742e852f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:36.464358 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f974a3c2-7b95-402c-a23d-ea9e742e852f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:36.464751 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f974a3c2-7b95-402c-a23d-ea9e742e852f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:36.465564 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f974a3c2-7b95-402c-a23d-ea9e742e852f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:36.465995 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f974a3c2-7b95-402c-a23d-ea9e742e852f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:36.910885 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f974a3c2-7b95-402c-a23d-ea9e742e852f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:36.920364 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f974a3c2-7b95-402c-a23d-ea9e742e852f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:36.922670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f974a3c2-7b95-402c-a23d-ea9e742e852f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:36.923569 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f974a3c2-7b95-402c-a23d-ea9e742e852f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.471048 Jul 20 11:38:36.924224 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 212/435] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:36 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:37.123453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d4b2403-8f78-4424-b8d5-a935acaff17a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:37.124083 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d4b2403-8f78-4424-b8d5-a935acaff17a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:37.130392 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d4b2403-8f78-4424-b8d5-a935acaff17a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:37.131253 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d4b2403-8f78-4424-b8d5-a935acaff17a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:37.132214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d4b2403-8f78-4424-b8d5-a935acaff17a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:37.132831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d4b2403-8f78-4424-b8d5-a935acaff17a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:37.209190 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d4b2403-8f78-4424-b8d5-a935acaff17a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:37.217376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3d4b2403-8f78-4424-b8d5-a935acaff17a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1302 microversion: 2.1 time: 0.097745 Jul 20 11:38:37.217952 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 224/436] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:37 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1302 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:37.802487 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-086a424e-5994-47a7-aa5d-8e683d8654f1 req-0e72fd9c-5fee-43c0-9c0c-ce1a79e0ad84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3abfd3-22be-4728-9006-19ad38c1bd9c", "name": "network-vif-plugged", "status": "completed", "tag": "e605e30c-d865-4978-9798-9dc53408552e"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:37.811576 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-086a424e-5994-47a7-aa5d-8e683d8654f1 req-0e72fd9c-5fee-43c0-9c0c-ce1a79e0ad84 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:37.812014 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-086a424e-5994-47a7-aa5d-8e683d8654f1 req-0e72fd9c-5fee-43c0-9c0c-ce1a79e0ad84 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:37.822738 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-086a424e-5994-47a7-aa5d-8e683d8654f1 req-0e72fd9c-5fee-43c0-9c0c-ce1a79e0ad84 service nova] Creating event network-vif-plugged:e605e30c-d865-4978-9798-9dc53408552e for instance ea3abfd3-22be-4728-9006-19ad38c1bd9c on hv-cinder-82282 Jul 20 11:38:37.827657 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-086a424e-5994-47a7-aa5d-8e683d8654f1 req-0e72fd9c-5fee-43c0-9c0c-ce1a79e0ad84 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028872 Jul 20 11:38:37.828230 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 213/437] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:37.944520 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d02a97aa-3702-4dbf-8447-9dbddc77b269 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:37.946313 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d02a97aa-3702-4dbf-8447-9dbddc77b269 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:37.959459 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d02a97aa-3702-4dbf-8447-9dbddc77b269 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:37.959938 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d02a97aa-3702-4dbf-8447-9dbddc77b269 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:37.960733 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d02a97aa-3702-4dbf-8447-9dbddc77b269 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:37.965542 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d02a97aa-3702-4dbf-8447-9dbddc77b269 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:38.190452 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d02a97aa-3702-4dbf-8447-9dbddc77b269 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:38.206738 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d02a97aa-3702-4dbf-8447-9dbddc77b269 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:38.208367 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d02a97aa-3702-4dbf-8447-9dbddc77b269 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:38.209595 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d02a97aa-3702-4dbf-8447-9dbddc77b269 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.269822 Jul 20 11:38:38.210162 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 225/438] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:37 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:38.235561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-72c18ba6-c08b-4379-97f6-35c4271e9955 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:38.236608 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-72c18ba6-c08b-4379-97f6-35c4271e9955 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:38.246292 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72c18ba6-c08b-4379-97f6-35c4271e9955 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:38.246742 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72c18ba6-c08b-4379-97f6-35c4271e9955 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:38.247523 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72c18ba6-c08b-4379-97f6-35c4271e9955 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:38.247964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72c18ba6-c08b-4379-97f6-35c4271e9955 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:38.267156 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:38.380155 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-72c18ba6-c08b-4379-97f6-35c4271e9955 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:38.389602 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-72c18ba6-c08b-4379-97f6-35c4271e9955 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.158360 Jul 20 11:38:38.390317 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 214/439] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:38 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:38.431356 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-059cd179-a9c9-4634-97a6-2416ba8a7a33 req-68b1cda6-944b-497c-816b-8266b112b5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78cd1446-9e8f-4683-8f7f-1be9fff0bc94", "tag": "f6467344-0b58-4e3a-9d8a-0f4ddb0d4cb1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:38.441970 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-059cd179-a9c9-4634-97a6-2416ba8a7a33 req-68b1cda6-944b-497c-816b-8266b112b5f5 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:38.442406 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-059cd179-a9c9-4634-97a6-2416ba8a7a33 req-68b1cda6-944b-497c-816b-8266b112b5f5 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:38.456839 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-059cd179-a9c9-4634-97a6-2416ba8a7a33 req-68b1cda6-944b-497c-816b-8266b112b5f5 service nova] Creating event network-changed:f6467344-0b58-4e3a-9d8a-0f4ddb0d4cb1 for instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 on hv-cinder-82282 Jul 20 11:38:38.465936 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-059cd179-a9c9-4634-97a6-2416ba8a7a33 req-68b1cda6-944b-497c-816b-8266b112b5f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038437 Jul 20 11:38:38.466666 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 226/440] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:39.228406 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1b653bcf-04c1-4002-a7b8-59aeb7fb7c4b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:39.237012 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1b653bcf-04c1-4002-a7b8-59aeb7fb7c4b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:39.244085 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b653bcf-04c1-4002-a7b8-59aeb7fb7c4b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:39.244538 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b653bcf-04c1-4002-a7b8-59aeb7fb7c4b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:39.245428 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b653bcf-04c1-4002-a7b8-59aeb7fb7c4b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:39.245774 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b653bcf-04c1-4002-a7b8-59aeb7fb7c4b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:39.394830 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1b653bcf-04c1-4002-a7b8-59aeb7fb7c4b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:39.403630 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1b653bcf-04c1-4002-a7b8-59aeb7fb7c4b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:39.405215 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1b653bcf-04c1-4002-a7b8-59aeb7fb7c4b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:39.406326 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1b653bcf-04c1-4002-a7b8-59aeb7fb7c4b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.182176 Jul 20 11:38:39.406883 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 215/441] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:39 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:39.407732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-873673a1-0192-4d88-b355-28e574aedebc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:39.408471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-873673a1-0192-4d88-b355-28e574aedebc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:39.414883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-873673a1-0192-4d88-b355-28e574aedebc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:39.415335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-873673a1-0192-4d88-b355-28e574aedebc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:39.416120 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-873673a1-0192-4d88-b355-28e574aedebc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:39.416557 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-873673a1-0192-4d88-b355-28e574aedebc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:39.671814 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-873673a1-0192-4d88-b355-28e574aedebc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:39.679368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-873673a1-0192-4d88-b355-28e574aedebc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.276075 Jul 20 11:38:39.679927 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 227/442] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:39 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:40.288657 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1593446491", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "networks": [{"uuid": "7da48c38-4590-41ed-b660-5ca513c6073b"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:40.339952 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] validate_networks() for [('7da48c38-4590-41ed-b660-5ca513c6073b', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:38:40.424030 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f47b389d-87e5-49f7-878e-3f5dd987d27f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:40.424634 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f47b389d-87e5-49f7-878e-3f5dd987d27f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:40.430526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f47b389d-87e5-49f7-878e-3f5dd987d27f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:40.430978 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f47b389d-87e5-49f7-878e-3f5dd987d27f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:40.431815 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f47b389d-87e5-49f7-878e-3f5dd987d27f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:40.432250 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f47b389d-87e5-49f7-878e-3f5dd987d27f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:40.639269 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f47b389d-87e5-49f7-878e-3f5dd987d27f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:40.646996 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f47b389d-87e5-49f7-878e-3f5dd987d27f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:40.648487 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f47b389d-87e5-49f7-878e-3f5dd987d27f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:40.649608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f47b389d-87e5-49f7-878e-3f5dd987d27f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.229537 Jul 20 11:38:40.650156 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 228/443] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:40 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:38:40.695921 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-df4c83c0-bf87-40b5-9e02-c48d77e4cd77 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:40.696668 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-df4c83c0-bf87-40b5-9e02-c48d77e4cd77 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:40.702569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df4c83c0-bf87-40b5-9e02-c48d77e4cd77 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:40.703012 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df4c83c0-bf87-40b5-9e02-c48d77e4cd77 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:40.703767 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df4c83c0-bf87-40b5-9e02-c48d77e4cd77 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:40.704196 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df4c83c0-bf87-40b5-9e02-c48d77e4cd77 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:40.753635 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:38:40.754151 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:38:40.754692 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:38:40.755168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:38:40.755651 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:38:40.765480 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:40.765927 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:40.766736 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:40.767171 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:40.784253 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Getting quotas for project 6c3490e18f0c4312a4f7ee37db18344f. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:38:40.788418 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Getting quotas for user 8c1fcfa9effd4d66ad1fef744393a04c and project 6c3490e18f0c4312a4f7ee37db18344f. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:38:40.799935 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:38:40.802252 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:38:40.839954 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-df4c83c0-bf87-40b5-9e02-c48d77e4cd77 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:40.847379 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-df4c83c0-bf87-40b5-9e02-c48d77e4cd77 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.155269 Jul 20 11:38:40.851416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 229/444] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:40 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:40.963280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4b64f0a1-7ba0-426c-8116-f553de963d51 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678339 Jul 20 11:38:40.964571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 216/445] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:38:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:38:40.974732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be869188-a3bf-497c-be0c-eb4661974b03 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:40.975374 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be869188-a3bf-497c-be0c-eb4661974b03 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:41.040557 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-be869188-a3bf-497c-be0c-eb4661974b03 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:41.047299 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be869188-a3bf-497c-be0c-eb4661974b03 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1219 microversion: 2.1 time: 0.076269 Jul 20 11:38:41.047841 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 230/446] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:40 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:41.669231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-40ef8cdc-7ee7-4bcd-a819-559b14e4172f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:41.669854 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-40ef8cdc-7ee7-4bcd-a819-559b14e4172f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:41.676042 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40ef8cdc-7ee7-4bcd-a819-559b14e4172f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:41.676384 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40ef8cdc-7ee7-4bcd-a819-559b14e4172f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:41.677184 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40ef8cdc-7ee7-4bcd-a819-559b14e4172f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:41.677618 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40ef8cdc-7ee7-4bcd-a819-559b14e4172f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:41.803239 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-40ef8cdc-7ee7-4bcd-a819-559b14e4172f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:41.811908 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-40ef8cdc-7ee7-4bcd-a819-559b14e4172f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:41.813474 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-40ef8cdc-7ee7-4bcd-a819-559b14e4172f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:41.814591 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-40ef8cdc-7ee7-4bcd-a819-559b14e4172f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.150401 Jul 20 11:38:41.815156 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 217/447] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:41 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:41.865044 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8f43a9c5-1a04-4511-9b7f-c9201d835199 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:41.866270 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8f43a9c5-1a04-4511-9b7f-c9201d835199 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:41.873350 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f43a9c5-1a04-4511-9b7f-c9201d835199 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:41.873843 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f43a9c5-1a04-4511-9b7f-c9201d835199 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:41.875486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f43a9c5-1a04-4511-9b7f-c9201d835199 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:41.875984 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8f43a9c5-1a04-4511-9b7f-c9201d835199 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:42.011213 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8f43a9c5-1a04-4511-9b7f-c9201d835199 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:42.019248 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8f43a9c5-1a04-4511-9b7f-c9201d835199 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.158131 Jul 20 11:38:42.019820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 231/448] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:41 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:42.063386 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9ba434c-68a9-420a-ad7b-7cc5658bad9d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:42.064005 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a9ba434c-68a9-420a-ad7b-7cc5658bad9d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:42.069971 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9ba434c-68a9-420a-ad7b-7cc5658bad9d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:42.070420 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9ba434c-68a9-420a-ad7b-7cc5658bad9d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:42.071192 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9ba434c-68a9-420a-ad7b-7cc5658bad9d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:42.071651 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9ba434c-68a9-420a-ad7b-7cc5658bad9d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:42.130350 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a9ba434c-68a9-420a-ad7b-7cc5658bad9d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:42.137887 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a9ba434c-68a9-420a-ad7b-7cc5658bad9d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1223 microversion: 2.1 time: 0.078316 Jul 20 11:38:42.138460 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 218/449] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:42 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:42.832397 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a50d5fba-279d-448f-b463-fc9c3371f28e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:42.833030 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a50d5fba-279d-448f-b463-fc9c3371f28e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:42.838989 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a50d5fba-279d-448f-b463-fc9c3371f28e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:42.839479 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a50d5fba-279d-448f-b463-fc9c3371f28e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:42.840234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a50d5fba-279d-448f-b463-fc9c3371f28e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:42.840658 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a50d5fba-279d-448f-b463-fc9c3371f28e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:42.977814 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a50d5fba-279d-448f-b463-fc9c3371f28e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:42.986112 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a50d5fba-279d-448f-b463-fc9c3371f28e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:42.987631 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a50d5fba-279d-448f-b463-fc9c3371f28e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:42.988722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a50d5fba-279d-448f-b463-fc9c3371f28e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.160233 Jul 20 11:38:42.989295 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 232/450] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:42 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:43.036211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-471dd831-43de-43dd-bbeb-db965f6ca287 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:43.036830 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-471dd831-43de-43dd-bbeb-db965f6ca287 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:43.043724 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-471dd831-43de-43dd-bbeb-db965f6ca287 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:43.044169 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-471dd831-43de-43dd-bbeb-db965f6ca287 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:43.044968 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-471dd831-43de-43dd-bbeb-db965f6ca287 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:43.045418 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-471dd831-43de-43dd-bbeb-db965f6ca287 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:43.154398 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee39181e-27d1-4be2-a2fa-0015baf6d6fa tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:43.155004 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ee39181e-27d1-4be2-a2fa-0015baf6d6fa tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:43.160944 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee39181e-27d1-4be2-a2fa-0015baf6d6fa tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:43.161392 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee39181e-27d1-4be2-a2fa-0015baf6d6fa tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:43.162180 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee39181e-27d1-4be2-a2fa-0015baf6d6fa tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:43.162613 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee39181e-27d1-4be2-a2fa-0015baf6d6fa tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:43.174356 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-471dd831-43de-43dd-bbeb-db965f6ca287 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:43.181716 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-471dd831-43de-43dd-bbeb-db965f6ca287 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.149331 Jul 20 11:38:43.182451 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 219/451] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:43 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:43.221838 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee39181e-27d1-4be2-a2fa-0015baf6d6fa tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:43.229034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee39181e-27d1-4be2-a2fa-0015baf6d6fa tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1223 microversion: 2.1 time: 0.078403 Jul 20 11:38:43.229594 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 233/452] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:43 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:44.006772 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-db70b918-4bde-466a-bed2-07182fbf9a40 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:44.007370 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-db70b918-4bde-466a-bed2-07182fbf9a40 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:44.013886 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db70b918-4bde-466a-bed2-07182fbf9a40 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:44.014325 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db70b918-4bde-466a-bed2-07182fbf9a40 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:44.015107 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db70b918-4bde-466a-bed2-07182fbf9a40 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:44.015533 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db70b918-4bde-466a-bed2-07182fbf9a40 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:44.140729 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-db70b918-4bde-466a-bed2-07182fbf9a40 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:44.148599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-db70b918-4bde-466a-bed2-07182fbf9a40 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:44.150128 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-db70b918-4bde-466a-bed2-07182fbf9a40 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:44.151227 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-db70b918-4bde-466a-bed2-07182fbf9a40 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.148392 Jul 20 11:38:44.151786 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 220/453] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:44 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:44.198253 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-05980373-a309-49cd-9fd1-ca96f52d5d13 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:44.198889 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-05980373-a309-49cd-9fd1-ca96f52d5d13 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:44.201449 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:44.206299 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-05980373-a309-49cd-9fd1-ca96f52d5d13 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:44.206743 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-05980373-a309-49cd-9fd1-ca96f52d5d13 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:44.207506 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-05980373-a309-49cd-9fd1-ca96f52d5d13 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:44.207942 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-05980373-a309-49cd-9fd1-ca96f52d5d13 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:44.246958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-16f853bb-448c-44f7-bbbc-cb6553ca18ca tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:44.247670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-16f853bb-448c-44f7-bbbc-cb6553ca18ca tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:44.254610 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16f853bb-448c-44f7-bbbc-cb6553ca18ca tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:44.255872 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16f853bb-448c-44f7-bbbc-cb6553ca18ca tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:44.256713 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16f853bb-448c-44f7-bbbc-cb6553ca18ca tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:44.259739 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-16f853bb-448c-44f7-bbbc-cb6553ca18ca tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:44.348376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-16f853bb-448c-44f7-bbbc-cb6553ca18ca tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:44.356115 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-16f853bb-448c-44f7-bbbc-cb6553ca18ca tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1223 microversion: 2.1 time: 0.113603 Jul 20 11:38:44.356824 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 221/454] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:44 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:44.375723 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-05980373-a309-49cd-9fd1-ca96f52d5d13 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:44.383248 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-05980373-a309-49cd-9fd1-ca96f52d5d13 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.188787 Jul 20 11:38:44.383814 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 234/455] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:44 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:45.169267 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b8aa1e0f-fb58-4178-8045-f144f9872dff tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:45.169787 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b8aa1e0f-fb58-4178-8045-f144f9872dff tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:45.176258 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8aa1e0f-fb58-4178-8045-f144f9872dff tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:45.176704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8aa1e0f-fb58-4178-8045-f144f9872dff tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:45.177541 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8aa1e0f-fb58-4178-8045-f144f9872dff tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:45.177975 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8aa1e0f-fb58-4178-8045-f144f9872dff tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:45.318309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b8aa1e0f-fb58-4178-8045-f144f9872dff tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:45.326265 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b8aa1e0f-fb58-4178-8045-f144f9872dff tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:45.327784 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b8aa1e0f-fb58-4178-8045-f144f9872dff tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:45.328904 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b8aa1e0f-fb58-4178-8045-f144f9872dff tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.163704 Jul 20 11:38:45.329462 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 222/456] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:45 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:45.373513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0d690ecb-0bc9-48c4-a17e-761bc4c42656 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:45.374142 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0d690ecb-0bc9-48c4-a17e-761bc4c42656 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:45.380053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d690ecb-0bc9-48c4-a17e-761bc4c42656 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:45.380503 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d690ecb-0bc9-48c4-a17e-761bc4c42656 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:45.381308 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d690ecb-0bc9-48c4-a17e-761bc4c42656 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:45.381744 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0d690ecb-0bc9-48c4-a17e-761bc4c42656 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:45.400292 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:45.401089 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1c2fa4d2-6376-43ea-9930-de4256b1c286 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:45.401808 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1c2fa4d2-6376-43ea-9930-de4256b1c286 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:45.408808 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c2fa4d2-6376-43ea-9930-de4256b1c286 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:45.411429 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c2fa4d2-6376-43ea-9930-de4256b1c286 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:45.411429 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c2fa4d2-6376-43ea-9930-de4256b1c286 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:45.411429 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c2fa4d2-6376-43ea-9930-de4256b1c286 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:45.443868 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0d690ecb-0bc9-48c4-a17e-761bc4c42656 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:45.451435 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0d690ecb-0bc9-48c4-a17e-761bc4c42656 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1223 microversion: 2.1 time: 0.082486 Jul 20 11:38:45.452123 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 235/457] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:45 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:45.545057 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1c2fa4d2-6376-43ea-9930-de4256b1c286 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:45.552984 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1c2fa4d2-6376-43ea-9930-de4256b1c286 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.156352 Jul 20 11:38:45.553540 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 223/458] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:45 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:46.347207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fcb842a2-9e3a-45c3-8648-11d4c5efc2d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:46.347820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fcb842a2-9e3a-45c3-8648-11d4c5efc2d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:46.353796 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcb842a2-9e3a-45c3-8648-11d4c5efc2d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:46.354251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcb842a2-9e3a-45c3-8648-11d4c5efc2d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:46.355014 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcb842a2-9e3a-45c3-8648-11d4c5efc2d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:46.355453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcb842a2-9e3a-45c3-8648-11d4c5efc2d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:46.468571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4c68a317-74e0-499c-87d2-cc83210567e3 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:46.474146 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4c68a317-74e0-499c-87d2-cc83210567e3 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:46.475795 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c68a317-74e0-499c-87d2-cc83210567e3 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:46.476244 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c68a317-74e0-499c-87d2-cc83210567e3 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:46.485387 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c68a317-74e0-499c-87d2-cc83210567e3 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:46.485870 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4c68a317-74e0-499c-87d2-cc83210567e3 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:46.557954 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4c68a317-74e0-499c-87d2-cc83210567e3 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:46.561961 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fcb842a2-9e3a-45c3-8648-11d4c5efc2d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:46.566180 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4c68a317-74e0-499c-87d2-cc83210567e3 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1223 microversion: 2.1 time: 0.101437 Jul 20 11:38:46.566756 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 224/459] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:46 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:46.571284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4ed5dbab-cc27-47c4-a477-cb3670e39859 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:46.571726 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fcb842a2-9e3a-45c3-8648-11d4c5efc2d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:46.571866 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4ed5dbab-cc27-47c4-a477-cb3670e39859 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:46.573402 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fcb842a2-9e3a-45c3-8648-11d4c5efc2d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:46.575175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fcb842a2-9e3a-45c3-8648-11d4c5efc2d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1408 microversion: 2.20 time: 0.231872 Jul 20 11:38:46.579619 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ed5dbab-cc27-47c4-a477-cb3670e39859 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:46.580062 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ed5dbab-cc27-47c4-a477-cb3670e39859 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:46.580849 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ed5dbab-cc27-47c4-a477-cb3670e39859 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:46.581279 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4ed5dbab-cc27-47c4-a477-cb3670e39859 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:46.585595 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 236/460] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:46 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:38:46.712078 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4ed5dbab-cc27-47c4-a477-cb3670e39859 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:46.721904 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4ed5dbab-cc27-47c4-a477-cb3670e39859 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.153722 Jul 20 11:38:46.722098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 225/461] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:46 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:47.583992 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c16483fe-6224-4749-b76f-d6a60571e79d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:47.584626 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c16483fe-6224-4749-b76f-d6a60571e79d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:47.590916 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c16483fe-6224-4749-b76f-d6a60571e79d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:47.591357 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c16483fe-6224-4749-b76f-d6a60571e79d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:47.592149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c16483fe-6224-4749-b76f-d6a60571e79d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:47.592573 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c16483fe-6224-4749-b76f-d6a60571e79d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:47.592969 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-78f5298e-1af2-42e3-bb92-87c2ebd55ccf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:47.593587 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-78f5298e-1af2-42e3-bb92-87c2ebd55ccf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:47.602196 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78f5298e-1af2-42e3-bb92-87c2ebd55ccf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:47.602645 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78f5298e-1af2-42e3-bb92-87c2ebd55ccf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:47.603421 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78f5298e-1af2-42e3-bb92-87c2ebd55ccf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:47.603856 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-78f5298e-1af2-42e3-bb92-87c2ebd55ccf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:47.720328 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c16483fe-6224-4749-b76f-d6a60571e79d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:47.727671 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c16483fe-6224-4749-b76f-d6a60571e79d tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1215 microversion: 2.1 time: 0.148036 Jul 20 11:38:47.728241 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 237/462] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:47 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:47.743117 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b5ff8697-3526-49a1-9f2d-7160e5db62c6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:47.743813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b5ff8697-3526-49a1-9f2d-7160e5db62c6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:47.750559 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5ff8697-3526-49a1-9f2d-7160e5db62c6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:47.751256 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5ff8697-3526-49a1-9f2d-7160e5db62c6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:47.751965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5ff8697-3526-49a1-9f2d-7160e5db62c6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:47.752406 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b5ff8697-3526-49a1-9f2d-7160e5db62c6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:48.095260 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-78f5298e-1af2-42e3-bb92-87c2ebd55ccf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:48.103937 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-78f5298e-1af2-42e3-bb92-87c2ebd55ccf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:48.106112 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-78f5298e-1af2-42e3-bb92-87c2ebd55ccf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:48.107429 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-78f5298e-1af2-42e3-bb92-87c2ebd55ccf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1600 microversion: 2.20 time: 0.518333 Jul 20 11:38:48.108191 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 226/463] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:38:47 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1600 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:38:48.128423 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fe0f413f-62c2-480d-8543-d2104e2202cf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:48.130422 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fe0f413f-62c2-480d-8543-d2104e2202cf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:48.138514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe0f413f-62c2-480d-8543-d2104e2202cf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:48.138954 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe0f413f-62c2-480d-8543-d2104e2202cf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:48.140001 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe0f413f-62c2-480d-8543-d2104e2202cf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:48.140438 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe0f413f-62c2-480d-8543-d2104e2202cf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:48.247555 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fe0f413f-62c2-480d-8543-d2104e2202cf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.125651 Jul 20 11:38:48.248517 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 227/464] 10.222.0.43 () {60 vars in 1315 bytes} [Wed Jul 20 11:38:48 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:38:48.255651 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b5ff8697-3526-49a1-9f2d-7160e5db62c6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:48.264126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b5ff8697-3526-49a1-9f2d-7160e5db62c6 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.524929 Jul 20 11:38:48.273340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 238/465] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:47 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:48.655592 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cb621b66-fe4b-437d-8f94-ddef07b2e313 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:48.657245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cb621b66-fe4b-437d-8f94-ddef07b2e313 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:48.663347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb621b66-fe4b-437d-8f94-ddef07b2e313 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:48.663843 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb621b66-fe4b-437d-8f94-ddef07b2e313 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:48.664571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb621b66-fe4b-437d-8f94-ddef07b2e313 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:48.665121 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cb621b66-fe4b-437d-8f94-ddef07b2e313 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:48.750415 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-848289c5-6071-428f-8246-67798ad61ae9 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:48.751785 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-848289c5-6071-428f-8246-67798ad61ae9 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:48.758174 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-848289c5-6071-428f-8246-67798ad61ae9 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:48.760225 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-848289c5-6071-428f-8246-67798ad61ae9 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:48.760225 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-848289c5-6071-428f-8246-67798ad61ae9 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:48.760225 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-848289c5-6071-428f-8246-67798ad61ae9 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:48.844182 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-848289c5-6071-428f-8246-67798ad61ae9 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:48.852330 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-848289c5-6071-428f-8246-67798ad61ae9 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1279 microversion: 2.1 time: 0.106482 Jul 20 11:38:48.853155 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 239/466] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:48 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1279 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:49.007103 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cb621b66-fe4b-437d-8f94-ddef07b2e313 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:49.015324 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cb621b66-fe4b-437d-8f94-ddef07b2e313 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1595 microversion: 2.1 time: 0.364064 Jul 20 11:38:49.015996 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 228/467] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:48 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1595 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:49.280535 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d2fa8d32-a61e-47e6-b847-2d2f9d86e3ab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:49.281220 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d2fa8d32-a61e-47e6-b847-2d2f9d86e3ab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:49.287225 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2fa8d32-a61e-47e6-b847-2d2f9d86e3ab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:49.288840 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2fa8d32-a61e-47e6-b847-2d2f9d86e3ab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:49.288840 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2fa8d32-a61e-47e6-b847-2d2f9d86e3ab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:49.289054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2fa8d32-a61e-47e6-b847-2d2f9d86e3ab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:49.504729 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d2fa8d32-a61e-47e6-b847-2d2f9d86e3ab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:49.515004 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d2fa8d32-a61e-47e6-b847-2d2f9d86e3ab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.238540 Jul 20 11:38:49.516953 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 240/468] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:49 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:49.654716 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-c3dc317f-af53-4f70-b147-2efa6069645e req-524522b8-0648-4393-9a28-35189de499c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea3abfd3-22be-4728-9006-19ad38c1bd9c", "tag": "e605e30c-d865-4978-9798-9dc53408552e"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:49.671285 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c3dc317f-af53-4f70-b147-2efa6069645e req-524522b8-0648-4393-9a28-35189de499c3 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:49.672005 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c3dc317f-af53-4f70-b147-2efa6069645e req-524522b8-0648-4393-9a28-35189de499c3 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:49.689329 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-c3dc317f-af53-4f70-b147-2efa6069645e req-524522b8-0648-4393-9a28-35189de499c3 service nova] Creating event network-changed:e605e30c-d865-4978-9798-9dc53408552e for instance ea3abfd3-22be-4728-9006-19ad38c1bd9c on hv-cinder-82282 Jul 20 11:38:49.697633 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-c3dc317f-af53-4f70-b147-2efa6069645e req-524522b8-0648-4393-9a28-35189de499c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047063 Jul 20 11:38:49.704046 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 229/469] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:49.868512 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49b97d6e-6af4-4cf8-9e8e-732d8bc7f336 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:49.870395 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-49b97d6e-6af4-4cf8-9e8e-732d8bc7f336 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:49.878631 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49b97d6e-6af4-4cf8-9e8e-732d8bc7f336 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:49.879087 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49b97d6e-6af4-4cf8-9e8e-732d8bc7f336 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:49.879869 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49b97d6e-6af4-4cf8-9e8e-732d8bc7f336 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:49.880491 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49b97d6e-6af4-4cf8-9e8e-732d8bc7f336 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:49.956384 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-49b97d6e-6af4-4cf8-9e8e-732d8bc7f336 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:49.966807 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-49b97d6e-6af4-4cf8-9e8e-732d8bc7f336 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1279 microversion: 2.1 time: 0.101720 Jul 20 11:38:49.969154 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 241/470] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:49 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:50.534169 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-35529168-d626-4dec-94f1-2629f4c2e15a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:50.534870 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-35529168-d626-4dec-94f1-2629f4c2e15a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:50.541433 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35529168-d626-4dec-94f1-2629f4c2e15a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:50.541882 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35529168-d626-4dec-94f1-2629f4c2e15a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:50.543389 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35529168-d626-4dec-94f1-2629f4c2e15a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:50.544004 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-35529168-d626-4dec-94f1-2629f4c2e15a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:50.705570 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-35529168-d626-4dec-94f1-2629f4c2e15a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:50.713086 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-35529168-d626-4dec-94f1-2629f4c2e15a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.183033 Jul 20 11:38:50.716469 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 230/471] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:50 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:50.990443 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3a17852e-b928-44e8-beae-6a229147315a tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:50.991055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3a17852e-b928-44e8-beae-6a229147315a tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:50.997624 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a17852e-b928-44e8-beae-6a229147315a tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:50.998076 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a17852e-b928-44e8-beae-6a229147315a tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:50.998854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a17852e-b928-44e8-beae-6a229147315a tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:50.999469 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a17852e-b928-44e8-beae-6a229147315a tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:51.044496 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=10 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:51.066110 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3a17852e-b928-44e8-beae-6a229147315a tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:51.077933 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3a17852e-b928-44e8-beae-6a229147315a tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1279 microversion: 2.1 time: 0.091161 Jul 20 11:38:51.087247 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 242/472] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:50 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:51.238297 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-b3198219-bbe5-421d-b9b1-21e06d2deadd req-3792d655-8f17-4739-8048-2f639c08bb5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ace499-ddc8-4a47-8e3d-730594d57bfa", "tag": "7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:51.241940 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:51.242605 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=10 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:51.249766 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-b3198219-bbe5-421d-b9b1-21e06d2deadd req-3792d655-8f17-4739-8048-2f639c08bb5c service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:51.250492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-b3198219-bbe5-421d-b9b1-21e06d2deadd req-3792d655-8f17-4739-8048-2f639c08bb5c service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:51.264162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-b3198219-bbe5-421d-b9b1-21e06d2deadd req-3792d655-8f17-4739-8048-2f639c08bb5c service nova] Creating event network-changed:7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe for instance d0ace499-ddc8-4a47-8e3d-730594d57bfa on hv-cinder-82282 Jul 20 11:38:51.269408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-b3198219-bbe5-421d-b9b1-21e06d2deadd req-3792d655-8f17-4739-8048-2f639c08bb5c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034740 Jul 20 11:38:51.269998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 231/473] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:51.733210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-11e453c0-8b40-46c8-8250-291203fcced2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:51.736015 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-11e453c0-8b40-46c8-8250-291203fcced2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:51.742757 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11e453c0-8b40-46c8-8250-291203fcced2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:51.743791 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11e453c0-8b40-46c8-8250-291203fcced2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:51.744759 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11e453c0-8b40-46c8-8250-291203fcced2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:51.745637 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11e453c0-8b40-46c8-8250-291203fcced2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:52.017232 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-11e453c0-8b40-46c8-8250-291203fcced2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:52.032424 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-11e453c0-8b40-46c8-8250-291203fcced2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.305032 Jul 20 11:38:52.033609 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 243/474] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:51 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:52.095998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ea3feae8-052b-4dcd-bc7b-4984332ea471 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:52.096703 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ea3feae8-052b-4dcd-bc7b-4984332ea471 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:52.104695 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea3feae8-052b-4dcd-bc7b-4984332ea471 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:52.105182 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea3feae8-052b-4dcd-bc7b-4984332ea471 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:52.105992 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea3feae8-052b-4dcd-bc7b-4984332ea471 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:52.106424 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea3feae8-052b-4dcd-bc7b-4984332ea471 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:52.198323 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ea3feae8-052b-4dcd-bc7b-4984332ea471 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:52.206636 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ea3feae8-052b-4dcd-bc7b-4984332ea471 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1279 microversion: 2.1 time: 0.114774 Jul 20 11:38:52.207203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 232/475] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:52 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1279 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:53.054444 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8341f3e1-9a31-4264-a93a-76d0a6b1f18e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:53.055003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8341f3e1-9a31-4264-a93a-76d0a6b1f18e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:53.061628 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8341f3e1-9a31-4264-a93a-76d0a6b1f18e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:53.062115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8341f3e1-9a31-4264-a93a-76d0a6b1f18e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:53.062877 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8341f3e1-9a31-4264-a93a-76d0a6b1f18e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:53.063409 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8341f3e1-9a31-4264-a93a-76d0a6b1f18e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:53.226489 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8341f3e1-9a31-4264-a93a-76d0a6b1f18e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:53.227707 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ae42d69c-badc-4da0-ad4d-22c5b6089b87 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:53.228435 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ae42d69c-badc-4da0-ad4d-22c5b6089b87 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:53.235256 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8341f3e1-9a31-4264-a93a-76d0a6b1f18e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.186424 Jul 20 11:38:53.235931 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 244/476] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:53 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:53.236137 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae42d69c-badc-4da0-ad4d-22c5b6089b87 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:53.236596 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae42d69c-badc-4da0-ad4d-22c5b6089b87 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:53.241679 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae42d69c-badc-4da0-ad4d-22c5b6089b87 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:53.241679 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae42d69c-badc-4da0-ad4d-22c5b6089b87 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:53.257001 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:53.302359 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ae42d69c-badc-4da0-ad4d-22c5b6089b87 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:53.310697 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ae42d69c-badc-4da0-ad4d-22c5b6089b87 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1279 microversion: 2.1 time: 0.087069 Jul 20 11:38:53.311205 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 233/477] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:53 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:53.685354 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2ce96ae5-809f-4c6d-91a4-83c03feb39ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1708906274"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:53.688545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2ce96ae5-809f-4c6d-91a4-83c03feb39ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:53.691918 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ce96ae5-809f-4c6d-91a4-83c03feb39ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:53.692388 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ce96ae5-809f-4c6d-91a4-83c03feb39ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:53.693161 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ce96ae5-809f-4c6d-91a4-83c03feb39ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:53.693598 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2ce96ae5-809f-4c6d-91a4-83c03feb39ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:53.815643 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.network.security_group_api [None req-2ce96ae5-809f-4c6d-91a4-83c03feb39ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Adding security group 6757820c-4a73-420b-b02f-2e68eff9422d to port 7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe Jul 20 11:38:54.218149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2ce96ae5-809f-4c6d-91a4-83c03feb39ab tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "POST /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/action" status: 202 len: 0 microversion: 2.1 time: 0.536577 Jul 20 11:38:54.219364 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 245/478] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:38:53 2022] POST /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:38:54.230230 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-5e2fdb6e-215f-4d09-a657-640376ab1e53 req-b0a519df-e4a3-4018-a950-65eeb9f3c8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ace499-ddc8-4a47-8e3d-730594d57bfa", "tag": "7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:54.244138 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-5e2fdb6e-215f-4d09-a657-640376ab1e53 req-b0a519df-e4a3-4018-a950-65eeb9f3c8d8 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:54.245685 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-21a5567b-19c7-48bb-8ba5-f61624171367 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:54.248485 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-21a5567b-19c7-48bb-8ba5-f61624171367 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:54.248897 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:54.249626 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-5e2fdb6e-215f-4d09-a657-640376ab1e53 req-b0a519df-e4a3-4018-a950-65eeb9f3c8d8 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:54.263192 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-5e2fdb6e-215f-4d09-a657-640376ab1e53 req-b0a519df-e4a3-4018-a950-65eeb9f3c8d8 service nova] Creating event network-changed:7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe for instance d0ace499-ddc8-4a47-8e3d-730594d57bfa on hv-cinder-82282 Jul 20 11:38:54.268641 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21a5567b-19c7-48bb-8ba5-f61624171367 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:54.269130 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21a5567b-19c7-48bb-8ba5-f61624171367 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:54.269921 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21a5567b-19c7-48bb-8ba5-f61624171367 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:54.270366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-21a5567b-19c7-48bb-8ba5-f61624171367 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:54.282902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-5e2fdb6e-215f-4d09-a657-640376ab1e53 req-b0a519df-e4a3-4018-a950-65eeb9f3c8d8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057004 Jul 20 11:38:54.282902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 234/479] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:54.295146 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b5998d26-0764-4085-8293-00758c8be535 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:54.295917 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b5998d26-0764-4085-8293-00758c8be535 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:54.302320 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5998d26-0764-4085-8293-00758c8be535 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:54.302771 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5998d26-0764-4085-8293-00758c8be535 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:54.306028 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5998d26-0764-4085-8293-00758c8be535 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:54.306028 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5998d26-0764-4085-8293-00758c8be535 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:54.504556 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5998d26-0764-4085-8293-00758c8be535 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:54.509814 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-21a5567b-19c7-48bb-8ba5-f61624171367 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:54.512677 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b5998d26-0764-4085-8293-00758c8be535 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.228371 Jul 20 11:38:54.513285 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 235/480] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:54 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:54.517962 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-99c66d05-f043-4239-b4ab-fc79be4852b1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:54.518831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-99c66d05-f043-4239-b4ab-fc79be4852b1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:54.520837 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:38:54.525532 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99c66d05-f043-4239-b4ab-fc79be4852b1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:54.525981 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99c66d05-f043-4239-b4ab-fc79be4852b1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:54.526850 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-21a5567b-19c7-48bb-8ba5-f61624171367 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1642 microversion: 2.1 time: 0.290784 Jul 20 11:38:54.526975 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99c66d05-f043-4239-b4ab-fc79be4852b1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:54.527365 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-99c66d05-f043-4239-b4ab-fc79be4852b1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:54.527767 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 246/481] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:54 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1642 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:54.589053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-99c66d05-f043-4239-b4ab-fc79be4852b1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:54.597248 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-99c66d05-f043-4239-b4ab-fc79be4852b1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1279 microversion: 2.1 time: 0.082821 Jul 20 11:38:54.597806 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 236/482] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:54 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:55.530494 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-825266b5-c075-4736-8c52-0abd95146042 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:55.530494 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-825266b5-c075-4736-8c52-0abd95146042 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:55.539462 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-825266b5-c075-4736-8c52-0abd95146042 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:55.540151 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-825266b5-c075-4736-8c52-0abd95146042 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:55.540997 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-825266b5-c075-4736-8c52-0abd95146042 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:55.541443 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-825266b5-c075-4736-8c52-0abd95146042 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:55.616123 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ca540f63-aed6-464f-80b5-f38349415cfd tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:55.617575 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ca540f63-aed6-464f-80b5-f38349415cfd tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:55.626221 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca540f63-aed6-464f-80b5-f38349415cfd tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:55.627011 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca540f63-aed6-464f-80b5-f38349415cfd tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:55.628019 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca540f63-aed6-464f-80b5-f38349415cfd tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:55.628762 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ca540f63-aed6-464f-80b5-f38349415cfd tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:55.835140 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ca540f63-aed6-464f-80b5-f38349415cfd tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:55.846053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ca540f63-aed6-464f-80b5-f38349415cfd tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1279 microversion: 2.1 time: 0.235035 Jul 20 11:38:55.857805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 237/483] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:55 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1279 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:55.941860 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-825266b5-c075-4736-8c52-0abd95146042 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:55.945764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-825266b5-c075-4736-8c52-0abd95146042 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.420486 Jul 20 11:38:55.946665 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 247/484] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:55 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:56.864805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dd00715c-2e95-473a-b13d-e57b5420fe3e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:56.865563 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dd00715c-2e95-473a-b13d-e57b5420fe3e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:56.873265 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd00715c-2e95-473a-b13d-e57b5420fe3e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:56.873929 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd00715c-2e95-473a-b13d-e57b5420fe3e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:56.879988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd00715c-2e95-473a-b13d-e57b5420fe3e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:56.879988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd00715c-2e95-473a-b13d-e57b5420fe3e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:56.963100 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cffa1cbc-5094-4332-8049-efc318aa15ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:56.963648 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cffa1cbc-5094-4332-8049-efc318aa15ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:56.969898 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cffa1cbc-5094-4332-8049-efc318aa15ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:56.970347 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cffa1cbc-5094-4332-8049-efc318aa15ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:56.971117 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cffa1cbc-5094-4332-8049-efc318aa15ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:56.971555 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cffa1cbc-5094-4332-8049-efc318aa15ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:57.026313 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd00715c-2e95-473a-b13d-e57b5420fe3e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:57.043809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dd00715c-2e95-473a-b13d-e57b5420fe3e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.182448 Jul 20 11:38:57.044925 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 238/485] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:56 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:57.231503 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cffa1cbc-5094-4332-8049-efc318aa15ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:57.239123 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cffa1cbc-5094-4332-8049-efc318aa15ca tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.279945 Jul 20 11:38:57.242628 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 248/486] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:56 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:38:57.367417 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-b745f442-12e2-4d15-a0e2-254d6eb242e8 req-02e14fe2-8616-46ba-ac2c-68f5c67e9686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d15bd2-8390-4ee1-a0b8-02e575741616", "tag": "d9d051e8-f987-44a1-be3a-edd9b1d46a9b"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:57.378002 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-b745f442-12e2-4d15-a0e2-254d6eb242e8 req-02e14fe2-8616-46ba-ac2c-68f5c67e9686 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:57.378901 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-b745f442-12e2-4d15-a0e2-254d6eb242e8 req-02e14fe2-8616-46ba-ac2c-68f5c67e9686 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:57.393325 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-b745f442-12e2-4d15-a0e2-254d6eb242e8 req-02e14fe2-8616-46ba-ac2c-68f5c67e9686 service nova] Creating event network-changed:d9d051e8-f987-44a1-be3a-edd9b1d46a9b for instance f8d15bd2-8390-4ee1-a0b8-02e575741616 on hv-cinder-82282 Jul 20 11:38:57.398021 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-b745f442-12e2-4d15-a0e2-254d6eb242e8 req-02e14fe2-8616-46ba-ac2c-68f5c67e9686 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034448 Jul 20 11:38:57.398781 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 239/487] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:58.060876 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e6b7a554-ce38-4516-a437-4e8e95677a07 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:58.061539 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e6b7a554-ce38-4516-a437-4e8e95677a07 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:58.067607 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6b7a554-ce38-4516-a437-4e8e95677a07 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:58.068054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6b7a554-ce38-4516-a437-4e8e95677a07 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:58.068843 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6b7a554-ce38-4516-a437-4e8e95677a07 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:58.069282 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e6b7a554-ce38-4516-a437-4e8e95677a07 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:58.208322 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e6b7a554-ce38-4516-a437-4e8e95677a07 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:58.216218 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e6b7a554-ce38-4516-a437-4e8e95677a07 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.159242 Jul 20 11:38:58.216800 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 249/488] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:58 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:58.256720 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5f1b1515-ed83-4b65-b29e-2f9f74b9c476 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:58.257426 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5f1b1515-ed83-4b65-b29e-2f9f74b9c476 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:58.264540 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f1b1515-ed83-4b65-b29e-2f9f74b9c476 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:58.265010 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f1b1515-ed83-4b65-b29e-2f9f74b9c476 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:58.265767 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f1b1515-ed83-4b65-b29e-2f9f74b9c476 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:58.266197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f1b1515-ed83-4b65-b29e-2f9f74b9c476 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:58.408579 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f1b1515-ed83-4b65-b29e-2f9f74b9c476 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:58.416112 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5f1b1515-ed83-4b65-b29e-2f9f74b9c476 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.164069 Jul 20 11:38:58.416674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 240/489] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:58 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:58.565182 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-e7739ee0-6ee0-4e32-85c5-ebef58f81ab8 req-1c606a76-05de-41d6-a38b-b59dfd3e3e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78cd1446-9e8f-4683-8f7f-1be9fff0bc94", "name": "network-vif-plugged", "status": "completed", "tag": "f6467344-0b58-4e3a-9d8a-0f4ddb0d4cb1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:38:58.574066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e7739ee0-6ee0-4e32-85c5-ebef58f81ab8 req-1c606a76-05de-41d6-a38b-b59dfd3e3e90 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:58.575082 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e7739ee0-6ee0-4e32-85c5-ebef58f81ab8 req-1c606a76-05de-41d6-a38b-b59dfd3e3e90 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:58.586145 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-e7739ee0-6ee0-4e32-85c5-ebef58f81ab8 req-1c606a76-05de-41d6-a38b-b59dfd3e3e90 service nova] Creating event network-vif-plugged:f6467344-0b58-4e3a-9d8a-0f4ddb0d4cb1 for instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 on hv-cinder-82282 Jul 20 11:38:58.591381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-e7739ee0-6ee0-4e32-85c5-ebef58f81ab8 req-1c606a76-05de-41d6-a38b-b59dfd3e3e90 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030478 Jul 20 11:38:58.591997 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 250/490] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:59.233816 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2509e57c-6ebf-47ae-91c1-8e06fcc16f60 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:59.234426 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2509e57c-6ebf-47ae-91c1-8e06fcc16f60 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:59.240465 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2509e57c-6ebf-47ae-91c1-8e06fcc16f60 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:59.242688 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2509e57c-6ebf-47ae-91c1-8e06fcc16f60 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:59.242688 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2509e57c-6ebf-47ae-91c1-8e06fcc16f60 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:59.242688 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2509e57c-6ebf-47ae-91c1-8e06fcc16f60 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:59.380709 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2509e57c-6ebf-47ae-91c1-8e06fcc16f60 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:59.388431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2509e57c-6ebf-47ae-91c1-8e06fcc16f60 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.159039 Jul 20 11:38:59.389031 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 241/491] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:59 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:38:59.433528 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4ed9aa98-08ef-4f39-ae1c-3fc4d9971565 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:38:59.434223 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4ed9aa98-08ef-4f39-ae1c-3fc4d9971565 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:38:59.440361 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ed9aa98-08ef-4f39-ae1c-3fc4d9971565 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:59.440835 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ed9aa98-08ef-4f39-ae1c-3fc4d9971565 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:59.441609 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ed9aa98-08ef-4f39-ae1c-3fc4d9971565 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:38:59.442041 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4ed9aa98-08ef-4f39-ae1c-3fc4d9971565 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:38:59.579897 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4ed9aa98-08ef-4f39-ae1c-3fc4d9971565 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:38:59.588315 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4ed9aa98-08ef-4f39-ae1c-3fc4d9971565 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.159056 Jul 20 11:38:59.598394 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 251/492] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:38:59 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:00.405439 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bfe0621e-3c65-4cd5-a4a3-977a3f048a01 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:00.406040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bfe0621e-3c65-4cd5-a4a3-977a3f048a01 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:00.413149 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfe0621e-3c65-4cd5-a4a3-977a3f048a01 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:00.413600 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfe0621e-3c65-4cd5-a4a3-977a3f048a01 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:00.414460 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfe0621e-3c65-4cd5-a4a3-977a3f048a01 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:00.414775 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bfe0621e-3c65-4cd5-a4a3-977a3f048a01 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:00.548921 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bfe0621e-3c65-4cd5-a4a3-977a3f048a01 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:00.556435 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bfe0621e-3c65-4cd5-a4a3-977a3f048a01 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.155082 Jul 20 11:39:00.557036 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 242/493] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:00 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:00.607139 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bb9d0a80-ed68-48f6-82a3-11d135e1002a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:00.607845 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bb9d0a80-ed68-48f6-82a3-11d135e1002a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:00.613971 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb9d0a80-ed68-48f6-82a3-11d135e1002a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:00.616258 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb9d0a80-ed68-48f6-82a3-11d135e1002a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:00.616258 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb9d0a80-ed68-48f6-82a3-11d135e1002a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:00.616258 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bb9d0a80-ed68-48f6-82a3-11d135e1002a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:00.759073 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bb9d0a80-ed68-48f6-82a3-11d135e1002a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:00.766583 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bb9d0a80-ed68-48f6-82a3-11d135e1002a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.165086 Jul 20 11:39:00.767150 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 252/494] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:00 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:01.574199 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4f1f1272-e9de-49ab-865f-f90fd767fc47 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:01.575370 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4f1f1272-e9de-49ab-865f-f90fd767fc47 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:01.582561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f1f1272-e9de-49ab-865f-f90fd767fc47 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:01.583014 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f1f1272-e9de-49ab-865f-f90fd767fc47 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:01.583794 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f1f1272-e9de-49ab-865f-f90fd767fc47 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:01.584230 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4f1f1272-e9de-49ab-865f-f90fd767fc47 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:01.730961 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4f1f1272-e9de-49ab-865f-f90fd767fc47 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:01.738468 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4f1f1272-e9de-49ab-865f-f90fd767fc47 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.168328 Jul 20 11:39:01.739036 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 243/495] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:01 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:01.783894 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2bd10191-a478-4d52-8d4d-7693021eb80f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:01.786464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2bd10191-a478-4d52-8d4d-7693021eb80f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:01.792419 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bd10191-a478-4d52-8d4d-7693021eb80f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:01.793806 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bd10191-a478-4d52-8d4d-7693021eb80f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:01.794987 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bd10191-a478-4d52-8d4d-7693021eb80f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:01.795808 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bd10191-a478-4d52-8d4d-7693021eb80f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:01.802234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:39:01.944110 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2bd10191-a478-4d52-8d4d-7693021eb80f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:01.952133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2bd10191-a478-4d52-8d4d-7693021eb80f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.172431 Jul 20 11:39:01.957270 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 253/496] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:01 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:02.755961 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-90bb2cfe-4d42-4726-9c71-85c6acc63180 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:02.757210 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-90bb2cfe-4d42-4726-9c71-85c6acc63180 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:02.764604 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90bb2cfe-4d42-4726-9c71-85c6acc63180 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:02.765075 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90bb2cfe-4d42-4726-9c71-85c6acc63180 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:02.765860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90bb2cfe-4d42-4726-9c71-85c6acc63180 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:02.766291 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90bb2cfe-4d42-4726-9c71-85c6acc63180 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:02.969562 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bf0b4783-201b-4070-a5d1-88336d007198 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:02.970307 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bf0b4783-201b-4070-a5d1-88336d007198 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:02.976177 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf0b4783-201b-4070-a5d1-88336d007198 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:02.976909 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf0b4783-201b-4070-a5d1-88336d007198 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:02.977694 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf0b4783-201b-4070-a5d1-88336d007198 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:02.978127 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf0b4783-201b-4070-a5d1-88336d007198 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:03.179359 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90bb2cfe-4d42-4726-9c71-85c6acc63180 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:03.190108 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-90bb2cfe-4d42-4726-9c71-85c6acc63180 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.437831 Jul 20 11:39:03.190884 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 244/497] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:02 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:03.287697 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf0b4783-201b-4070-a5d1-88336d007198 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:03.299555 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bf0b4783-201b-4070-a5d1-88336d007198 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.333803 Jul 20 11:39:03.301374 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 254/498] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:02 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:39:04.207160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a11243f6-8e75-4330-9168-e92c375c901e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:04.207749 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a11243f6-8e75-4330-9168-e92c375c901e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:04.214467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a11243f6-8e75-4330-9168-e92c375c901e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:04.214905 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a11243f6-8e75-4330-9168-e92c375c901e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:04.216524 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a11243f6-8e75-4330-9168-e92c375c901e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:04.217139 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a11243f6-8e75-4330-9168-e92c375c901e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:04.319560 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4289b9e3-e68b-41ec-8daf-746bec387942 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:04.319560 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4289b9e3-e68b-41ec-8daf-746bec387942 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:04.329057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4289b9e3-e68b-41ec-8daf-746bec387942 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:04.329765 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4289b9e3-e68b-41ec-8daf-746bec387942 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:04.331627 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4289b9e3-e68b-41ec-8daf-746bec387942 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:04.332436 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4289b9e3-e68b-41ec-8daf-746bec387942 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:04.604719 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a11243f6-8e75-4330-9168-e92c375c901e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:04.613084 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a11243f6-8e75-4330-9168-e92c375c901e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.409667 Jul 20 11:39:04.613777 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 245/499] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:04 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:04.623780 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4289b9e3-e68b-41ec-8daf-746bec387942 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:04.632957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4289b9e3-e68b-41ec-8daf-746bec387942 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.318692 Jul 20 11:39:04.645296 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 255/500] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:04 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:05.630998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e4465e13-5e4f-4705-8084-e92f4f79411f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:05.631611 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e4465e13-5e4f-4705-8084-e92f4f79411f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:05.639425 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4465e13-5e4f-4705-8084-e92f4f79411f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:05.640088 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4465e13-5e4f-4705-8084-e92f4f79411f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:05.641090 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4465e13-5e4f-4705-8084-e92f4f79411f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:05.641718 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e4465e13-5e4f-4705-8084-e92f4f79411f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:05.654464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b769630a-89c4-4ccc-9b50-5655bed0a0ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:05.656765 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b769630a-89c4-4ccc-9b50-5655bed0a0ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:05.666673 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b769630a-89c4-4ccc-9b50-5655bed0a0ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:05.668277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b769630a-89c4-4ccc-9b50-5655bed0a0ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:05.671314 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b769630a-89c4-4ccc-9b50-5655bed0a0ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:05.672766 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b769630a-89c4-4ccc-9b50-5655bed0a0ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:05.947944 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e4465e13-5e4f-4705-8084-e92f4f79411f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:05.963004 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e4465e13-5e4f-4705-8084-e92f4f79411f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.334625 Jul 20 11:39:05.973572 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 246/501] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:05 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:05.990868 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b769630a-89c4-4ccc-9b50-5655bed0a0ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:06.000486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b769630a-89c4-4ccc-9b50-5655bed0a0ce tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1370 microversion: 2.1 time: 0.352897 Jul 20 11:39:06.019256 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 256/502] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:05 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1370 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:06.983108 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b4345cc1-aff6-4965-b774-4856a5e7063e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:06.983917 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b4345cc1-aff6-4965-b774-4856a5e7063e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:06.991433 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4345cc1-aff6-4965-b774-4856a5e7063e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:06.991886 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4345cc1-aff6-4965-b774-4856a5e7063e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:06.992891 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4345cc1-aff6-4965-b774-4856a5e7063e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:06.993504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4345cc1-aff6-4965-b774-4856a5e7063e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:07.018596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-48a930dd-12c6-49d4-b5c2-a5422f5c8c76 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:07.019220 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-48a930dd-12c6-49d4-b5c2-a5422f5c8c76 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:07.030721 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48a930dd-12c6-49d4-b5c2-a5422f5c8c76 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:07.031559 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48a930dd-12c6-49d4-b5c2-a5422f5c8c76 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:07.032532 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48a930dd-12c6-49d4-b5c2-a5422f5c8c76 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:07.033197 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-48a930dd-12c6-49d4-b5c2-a5422f5c8c76 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:07.343410 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b4345cc1-aff6-4965-b774-4856a5e7063e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:07.357210 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b4345cc1-aff6-4965-b774-4856a5e7063e tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.377926 Jul 20 11:39:07.358196 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 247/503] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:06 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:07.362364 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-48a930dd-12c6-49d4-b5c2-a5422f5c8c76 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:07.371431 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-48a930dd-12c6-49d4-b5c2-a5422f5c8c76 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1564 microversion: 2.1 time: 0.356838 Jul 20 11:39:07.372959 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 257/504] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:07 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1564 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:39:07.389327 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f211c602-486b-4da8-a26b-6d7b6488c093 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:07.390147 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f211c602-486b-4da8-a26b-6d7b6488c093 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:07.398644 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f211c602-486b-4da8-a26b-6d7b6488c093 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:07.399430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f211c602-486b-4da8-a26b-6d7b6488c093 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:07.400461 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f211c602-486b-4da8-a26b-6d7b6488c093 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:07.401145 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f211c602-486b-4da8-a26b-6d7b6488c093 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:07.488901 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f211c602-486b-4da8-a26b-6d7b6488c093 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103902 Jul 20 11:39:07.489501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 248/505] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 11:39:07 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:39:08.375652 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b3265059-a16a-4f2d-a895-779ef6bf9c26 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:08.380876 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b3265059-a16a-4f2d-a895-779ef6bf9c26 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:08.384021 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3265059-a16a-4f2d-a895-779ef6bf9c26 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:08.384564 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3265059-a16a-4f2d-a895-779ef6bf9c26 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:08.385462 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3265059-a16a-4f2d-a895-779ef6bf9c26 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:08.386135 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3265059-a16a-4f2d-a895-779ef6bf9c26 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:08.604460 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b3265059-a16a-4f2d-a895-779ef6bf9c26 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:08.614827 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b3265059-a16a-4f2d-a895-779ef6bf9c26 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.243901 Jul 20 11:39:08.616231 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 258/506] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:08 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:08.632743 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-0a55041c-a2a4-4fb1-9732-dba9501c1a4e req-443e1654-5c44-4988-94c4-fd35cfceac8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78cd1446-9e8f-4683-8f7f-1be9fff0bc94", "tag": "f6467344-0b58-4e3a-9d8a-0f4ddb0d4cb1"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:39:08.645309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-0a55041c-a2a4-4fb1-9732-dba9501c1a4e req-443e1654-5c44-4988-94c4-fd35cfceac8e service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:08.646010 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-0a55041c-a2a4-4fb1-9732-dba9501c1a4e req-443e1654-5c44-4988-94c4-fd35cfceac8e service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:08.659837 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-0a55041c-a2a4-4fb1-9732-dba9501c1a4e req-443e1654-5c44-4988-94c4-fd35cfceac8e service nova] Creating event network-changed:f6467344-0b58-4e3a-9d8a-0f4ddb0d4cb1 for instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 on hv-cinder-82282 Jul 20 11:39:08.665251 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-0a55041c-a2a4-4fb1-9732-dba9501c1a4e req-443e1654-5c44-4988-94c4-fd35cfceac8e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046305 Jul 20 11:39:08.669874 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 249/507] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:39:09.637463 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d8cca091-1904-4ef1-8e1a-18e4eef33a73 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:09.640638 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d8cca091-1904-4ef1-8e1a-18e4eef33a73 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:09.656740 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8cca091-1904-4ef1-8e1a-18e4eef33a73 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:09.657624 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8cca091-1904-4ef1-8e1a-18e4eef33a73 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:09.659836 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8cca091-1904-4ef1-8e1a-18e4eef33a73 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:09.660509 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8cca091-1904-4ef1-8e1a-18e4eef33a73 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:09.839374 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d8cca091-1904-4ef1-8e1a-18e4eef33a73 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:09.850219 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d8cca091-1904-4ef1-8e1a-18e4eef33a73 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.216621 Jul 20 11:39:09.855924 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 259/508] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:09 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:10.880346 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ea8b0253-cc1d-46c5-ade9-b002771b5deb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:10.881087 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ea8b0253-cc1d-46c5-ade9-b002771b5deb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:10.892072 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea8b0253-cc1d-46c5-ade9-b002771b5deb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:10.892707 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea8b0253-cc1d-46c5-ade9-b002771b5deb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:10.894084 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea8b0253-cc1d-46c5-ade9-b002771b5deb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:10.895470 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ea8b0253-cc1d-46c5-ade9-b002771b5deb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:11.142508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ea8b0253-cc1d-46c5-ade9-b002771b5deb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:11.152818 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ea8b0253-cc1d-46c5-ade9-b002771b5deb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.278336 Jul 20 11:39:11.154383 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 250/509] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:10 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:11.850039 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-2eb34a00-75f2-459a-b1ec-ec17d6b576a6 req-ec355ce9-8929-49c3-8879-c167a0d9198c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d15bd2-8390-4ee1-a0b8-02e575741616", "name": "network-vif-plugged", "status": "completed", "tag": "d9d051e8-f987-44a1-be3a-edd9b1d46a9b"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:39:11.862044 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-2eb34a00-75f2-459a-b1ec-ec17d6b576a6 req-ec355ce9-8929-49c3-8879-c167a0d9198c service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:11.863560 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-2eb34a00-75f2-459a-b1ec-ec17d6b576a6 req-ec355ce9-8929-49c3-8879-c167a0d9198c service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:11.885790 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-2eb34a00-75f2-459a-b1ec-ec17d6b576a6 req-ec355ce9-8929-49c3-8879-c167a0d9198c service nova] Creating event network-vif-plugged:d9d051e8-f987-44a1-be3a-edd9b1d46a9b for instance f8d15bd2-8390-4ee1-a0b8-02e575741616 on hv-cinder-82282 Jul 20 11:39:11.892862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-2eb34a00-75f2-459a-b1ec-ec17d6b576a6 req-ec355ce9-8929-49c3-8879-c167a0d9198c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046956 Jul 20 11:39:11.894625 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 260/510] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:39:12.171881 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-72be73c5-731c-4e2f-8a39-c1283b8d72bb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:12.181862 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-72be73c5-731c-4e2f-8a39-c1283b8d72bb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:12.189737 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72be73c5-731c-4e2f-8a39-c1283b8d72bb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:12.190439 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72be73c5-731c-4e2f-8a39-c1283b8d72bb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:12.191635 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72be73c5-731c-4e2f-8a39-c1283b8d72bb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:12.192311 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-72be73c5-731c-4e2f-8a39-c1283b8d72bb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:12.563513 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-72be73c5-731c-4e2f-8a39-c1283b8d72bb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:12.571982 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-72be73c5-731c-4e2f-8a39-c1283b8d72bb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.405013 Jul 20 11:39:12.572651 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 251/511] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:12 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:13.589716 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-efdc7562-aab9-4e9c-b95f-080be336c6c6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:13.590480 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-efdc7562-aab9-4e9c-b95f-080be336c6c6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:13.597307 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efdc7562-aab9-4e9c-b95f-080be336c6c6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:13.597753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efdc7562-aab9-4e9c-b95f-080be336c6c6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:13.598517 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efdc7562-aab9-4e9c-b95f-080be336c6c6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:13.599012 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efdc7562-aab9-4e9c-b95f-080be336c6c6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:14.107148 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-efdc7562-aab9-4e9c-b95f-080be336c6c6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:14.116627 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-efdc7562-aab9-4e9c-b95f-080be336c6c6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.531016 Jul 20 11:39:14.117381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 261/512] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:13 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:14.756190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7c81577e-ed6e-40d5-ac78-9a3105df6c07 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Action: 'create', calling method: .version_select at 0x7f44e010a8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1189455695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVaFkTBCDPkdm9HfMhnOfAmU6SmgmJZkxacYE5825TgrKArOfxP94Gv4/Gkg2NGyzoUG7adeFbezgJvJW3l6Bkv1d7YDcu1D6RbJoo+WVqqlv7VeTXtKY4gZ7stcN5OYg=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:39:14.778669 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-7c81577e-ed6e-40d5-ac78-9a3105df6c07 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Getting quotas for project cd8945c9c88e4f0e80f8f2345168827a. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:39:14.782589 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-7c81577e-ed6e-40d5-ac78-9a3105df6c07 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Getting quotas for user 5040464b9adb4ca3a8bb131ff11e0032 and project cd8945c9c88e4f0e80f8f2345168827a. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:39:14.861273 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7c81577e-ed6e-40d5-ac78-9a3105df6c07 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.304705 Jul 20 11:39:14.862578 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 252/513] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 11:39:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:39:15.135308 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-256fdad2-5454-4c8e-8970-15f3fab741ec tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:15.135929 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-256fdad2-5454-4c8e-8970-15f3fab741ec tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:15.145988 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-256fdad2-5454-4c8e-8970-15f3fab741ec tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:15.146440 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-256fdad2-5454-4c8e-8970-15f3fab741ec tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:15.147235 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-256fdad2-5454-4c8e-8970-15f3fab741ec tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:15.147666 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-256fdad2-5454-4c8e-8970-15f3fab741ec tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:15.316399 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-256fdad2-5454-4c8e-8970-15f3fab741ec tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:15.323833 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-256fdad2-5454-4c8e-8970-15f3fab741ec tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1319 microversion: 2.1 time: 0.192528 Jul 20 11:39:15.324777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 262/514] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:15 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:16.341885 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-21ea24e0-c5e1-4f4a-b8aa-b419743dc961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:16.342486 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-21ea24e0-c5e1-4f4a-b8aa-b419743dc961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:16.350811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21ea24e0-c5e1-4f4a-b8aa-b419743dc961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:16.351254 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21ea24e0-c5e1-4f4a-b8aa-b419743dc961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:16.352009 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21ea24e0-c5e1-4f4a-b8aa-b419743dc961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:16.352437 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-21ea24e0-c5e1-4f4a-b8aa-b419743dc961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:16.370609 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:39:16.494201 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-21ea24e0-c5e1-4f4a-b8aa-b419743dc961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:16.501758 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-21ea24e0-c5e1-4f4a-b8aa-b419743dc961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1507 microversion: 2.1 time: 0.164775 Jul 20 11:39:16.502320 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 253/515] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:16 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:35.070154 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f390ddc7-d308-4d2e-8757-e855045b8aa2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:35.070789 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f390ddc7-d308-4d2e-8757-e855045b8aa2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:35.072821 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=33 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:39:35.073463 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=54 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:39:35.078239 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f390ddc7-d308-4d2e-8757-e855045b8aa2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:35.081255 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f390ddc7-d308-4d2e-8757-e855045b8aa2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:35.081255 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f390ddc7-d308-4d2e-8757-e855045b8aa2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:35.081255 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f390ddc7-d308-4d2e-8757-e855045b8aa2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:35.103938 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f390ddc7-d308-4d2e-8757-e855045b8aa2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/ips" status: 200 len: 149 microversion: 2.1 time: 0.037789 Jul 20 11:39:35.104547 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 263/516] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 11:39:35 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:39:42.989065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5a99de32-ec98-48f3-b5d5-a9bdbf42156c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "927bee44-78c9-4906-937e-fe819e93f82b"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:39:42.990176 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5a99de32-ec98-48f3-b5d5-a9bdbf42156c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:42.992201 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:39:42.992926 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:39:42.993561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:39:42.998723 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a99de32-ec98-48f3-b5d5-a9bdbf42156c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:42.999173 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a99de32-ec98-48f3-b5d5-a9bdbf42156c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:42.999957 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a99de32-ec98-48f3-b5d5-a9bdbf42156c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:43.000394 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5a99de32-ec98-48f3-b5d5-a9bdbf42156c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:43.795290 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5a99de32-ec98-48f3-b5d5-a9bdbf42156c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "POST /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.810297 Jul 20 11:39:43.795908 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 254/517] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:39:42 2022] POST /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments => generated 194 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:39:56.568347 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4881f3f7-c9d7-4f90-a340-0dc8daf7cce5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Action: 'create', calling method: .version_select at 0x7f44e02dac10>, body: {"keypair": {"name": "tempest-keypair-1279161765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMLus1Jk1tn26pQSs+B+Q4ecNDzpE3i40RpL1t9DRHgGNYXdx0cW2HXBgbrYtAjd1KO0XK3D2I7hEjetfOkqJWz0bsmxV6WW3NhBI0MNpGisjDKpHWFXX1CXmAEkdhKuA=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:39:56.584204 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-4881f3f7-c9d7-4f90-a340-0dc8daf7cce5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for project d4fa73c956fe44a59272f727320743e0. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:39:56.588227 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-4881f3f7-c9d7-4f90-a340-0dc8daf7cce5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for user 54c7d577e64f48cab8c331ff192be0a6 and project d4fa73c956fe44a59272f727320743e0. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:39:56.673761 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4881f3f7-c9d7-4f90-a340-0dc8daf7cce5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109076 Jul 20 11:39:56.674510 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 264/518] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 11:39:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:39:58.946325 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-198760290", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85e4b01a-11ce-4686-bb2f-1c5b19de2e34"}], "security_groups": [{"name": "tempest-securitygroup--248761145"}], "key_name": "tempest-keypair-1279161765", "user_data": "}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:39:58.954226 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:39:58.954972 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:39:59.055396 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] validate_networks() for [('85e4b01a-11ce-4686-bb2f-1c5b19de2e34', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:39:59.430019 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:39:59.430441 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:39:59.430942 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:39:59.431350 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:39:59.431758 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:39:59.441032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:59.441482 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:59.442281 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:59.442718 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:59.459509 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for project d4fa73c956fe44a59272f727320743e0. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:39:59.463417 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for user 54c7d577e64f48cab8c331ff192be0a6 and project d4fa73c956fe44a59272f727320743e0. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:39:59.475028 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:39:59.477507 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:39:59.627553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f8f14809-6771-4f93-9d88-6da6ae031a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.685867 Jul 20 11:39:59.628371 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 255/519] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:39:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:39:59.640507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a91f2146-2414-41ae-9d18-c76205727d88 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:59.641216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a91f2146-2414-41ae-9d18-c76205727d88 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:59.698791 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a91f2146-2414-41ae-9d18-c76205727d88 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:59.705762 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a91f2146-2414-41ae-9d18-c76205727d88 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1241 microversion: 2.1 time: 0.071129 Jul 20 11:39:59.706279 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 265/520] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:59 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:00.724653 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-655362a1-d089-4134-bf0b-3465970aeb2b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:00.725298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-655362a1-d089-4134-bf0b-3465970aeb2b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:00.731704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-655362a1-d089-4134-bf0b-3465970aeb2b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:00.732158 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-655362a1-d089-4134-bf0b-3465970aeb2b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:00.732971 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-655362a1-d089-4134-bf0b-3465970aeb2b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:00.733411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-655362a1-d089-4134-bf0b-3465970aeb2b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:00.799354 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-655362a1-d089-4134-bf0b-3465970aeb2b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:00.806768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-655362a1-d089-4134-bf0b-3465970aeb2b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1245 microversion: 2.1 time: 0.086577 Jul 20 11:40:00.807327 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 256/521] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:00 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:01.827078 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-951c161d-2078-40d1-8fed-1faf8174c633 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:01.827858 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-951c161d-2078-40d1-8fed-1faf8174c633 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:01.833986 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-951c161d-2078-40d1-8fed-1faf8174c633 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:01.834437 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-951c161d-2078-40d1-8fed-1faf8174c633 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:01.835206 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-951c161d-2078-40d1-8fed-1faf8174c633 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:01.835639 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-951c161d-2078-40d1-8fed-1faf8174c633 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:01.913910 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-951c161d-2078-40d1-8fed-1faf8174c633 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:01.922125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-951c161d-2078-40d1-8fed-1faf8174c633 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1301 microversion: 2.1 time: 0.100045 Jul 20 11:40:01.922696 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 266/522] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:01 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:02.940373 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0289a48c-a534-42e9-ba60-051f2d29a8db tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:02.941050 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0289a48c-a534-42e9-ba60-051f2d29a8db tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:02.947826 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0289a48c-a534-42e9-ba60-051f2d29a8db tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:02.948282 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0289a48c-a534-42e9-ba60-051f2d29a8db tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:02.949301 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0289a48c-a534-42e9-ba60-051f2d29a8db tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:02.949742 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0289a48c-a534-42e9-ba60-051f2d29a8db tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:03.090129 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0289a48c-a534-42e9-ba60-051f2d29a8db tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:03.101627 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0289a48c-a534-42e9-ba60-051f2d29a8db tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1366 microversion: 2.1 time: 0.166091 Jul 20 11:40:03.102266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 257/523] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:02 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:03.542058 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-45c5db3b-ac70-4c05-b14f-dc02dca21622 req-a60b0d42-5b19-441e-9a0e-e8a0d9656c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd4c8483-4de8-465a-8214-90e2f2b77081", "tag": "9fb4e847-dc3d-4d4f-a6da-3e3b572e6708"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:03.551412 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-45c5db3b-ac70-4c05-b14f-dc02dca21622 req-a60b0d42-5b19-441e-9a0e-e8a0d9656c60 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:03.552104 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-45c5db3b-ac70-4c05-b14f-dc02dca21622 req-a60b0d42-5b19-441e-9a0e-e8a0d9656c60 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:03.567180 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-45c5db3b-ac70-4c05-b14f-dc02dca21622 req-a60b0d42-5b19-441e-9a0e-e8a0d9656c60 service nova] Creating event network-changed:9fb4e847-dc3d-4d4f-a6da-3e3b572e6708 for instance fd4c8483-4de8-465a-8214-90e2f2b77081 on hv-cinder-82282 Jul 20 11:40:03.577736 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-45c5db3b-ac70-4c05-b14f-dc02dca21622 req-a60b0d42-5b19-441e-9a0e-e8a0d9656c60 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038596 Jul 20 11:40:03.578636 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 267/524] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:04.119450 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ef6dc643-b74c-4abc-8973-362535080f7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:04.120160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ef6dc643-b74c-4abc-8973-362535080f7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:04.127484 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef6dc643-b74c-4abc-8973-362535080f7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:04.131750 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef6dc643-b74c-4abc-8973-362535080f7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:04.131750 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef6dc643-b74c-4abc-8973-362535080f7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:04.131750 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef6dc643-b74c-4abc-8973-362535080f7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:04.256025 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ef6dc643-b74c-4abc-8973-362535080f7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:04.264483 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ef6dc643-b74c-4abc-8973-362535080f7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1366 microversion: 2.1 time: 0.148371 Jul 20 11:40:04.265088 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 258/525] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:04 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:05.282800 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a813538-0f03-49d5-9aaa-bb70c7eb7de4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:05.283488 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6a813538-0f03-49d5-9aaa-bb70c7eb7de4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:05.289623 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a813538-0f03-49d5-9aaa-bb70c7eb7de4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:05.290064 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a813538-0f03-49d5-9aaa-bb70c7eb7de4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:05.290812 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a813538-0f03-49d5-9aaa-bb70c7eb7de4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:05.291238 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a813538-0f03-49d5-9aaa-bb70c7eb7de4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:05.421571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a813538-0f03-49d5-9aaa-bb70c7eb7de4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:05.429183 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a813538-0f03-49d5-9aaa-bb70c7eb7de4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1366 microversion: 2.1 time: 0.151196 Jul 20 11:40:05.429744 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 268/526] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:05 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:06.446043 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-82278325-90f7-4634-b3cc-1ea1814183a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:06.446642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-82278325-90f7-4634-b3cc-1ea1814183a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:06.453152 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82278325-90f7-4634-b3cc-1ea1814183a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:06.453532 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82278325-90f7-4634-b3cc-1ea1814183a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:06.454284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82278325-90f7-4634-b3cc-1ea1814183a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:06.454712 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82278325-90f7-4634-b3cc-1ea1814183a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:06.581935 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-82278325-90f7-4634-b3cc-1ea1814183a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:06.589284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-82278325-90f7-4634-b3cc-1ea1814183a8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1366 microversion: 2.1 time: 0.147056 Jul 20 11:40:06.589842 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 259/527] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:06 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:07.606780 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d757f63-1fcc-4934-864a-650e472043bb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:07.607328 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d757f63-1fcc-4934-864a-650e472043bb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:07.613940 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d757f63-1fcc-4934-864a-650e472043bb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:07.614382 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d757f63-1fcc-4934-864a-650e472043bb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:07.615131 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d757f63-1fcc-4934-864a-650e472043bb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:07.615564 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d757f63-1fcc-4934-864a-650e472043bb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:07.744871 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d757f63-1fcc-4934-864a-650e472043bb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:07.752061 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d757f63-1fcc-4934-864a-650e472043bb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1366 microversion: 2.1 time: 0.149194 Jul 20 11:40:07.752617 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 269/528] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:07 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:08.340679 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1703027541", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1189455695", "security_groups": [{"name": "tempest-secgroup-smoke-1797798194"}], "networks": [{"uuid": "7a4be17e-dcfb-44a0-aaae-98c2c3def73d"}], "block_device_mapping_v2": [{"uuid": "70916f49-fc72-42b6-9465-2a4ebb3be045", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:08.451412 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] validate_networks() for [('7a4be17e-dcfb-44a0-aaae-98c2c3def73d', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:40:08.768848 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-64ea2413-5f59-4326-9ed9-370e44823dfb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:08.769473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-64ea2413-5f59-4326-9ed9-370e44823dfb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:08.775668 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64ea2413-5f59-4326-9ed9-370e44823dfb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:08.776116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64ea2413-5f59-4326-9ed9-370e44823dfb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:08.776920 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64ea2413-5f59-4326-9ed9-370e44823dfb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:08.777387 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64ea2413-5f59-4326-9ed9-370e44823dfb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:08.845325 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:40:08.845938 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:40:08.846623 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:40:08.847096 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:40:08.847702 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:40:08.857489 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:08.858144 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:08.860370 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:08.860826 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:08.879670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Getting quotas for project cd8945c9c88e4f0e80f8f2345168827a. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:40:08.883491 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Getting quotas for user 5040464b9adb4ca3a8bb131ff11e0032 and project cd8945c9c88e4f0e80f8f2345168827a. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:40:08.921232 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-64ea2413-5f59-4326-9ed9-370e44823dfb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:08.929447 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-64ea2413-5f59-4326-9ed9-370e44823dfb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1366 microversion: 2.1 time: 0.165395 Jul 20 11:40:08.930012 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 270/529] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:08 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:40:08.934855 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0b545c93-9893-4151-bee6-37c76fd537d0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "918f09fd-6d50-481e-9a84-3ae650cc1607", "device": "/dev/sdb"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:08.936493 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0b545c93-9893-4151-bee6-37c76fd537d0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:08.943523 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b545c93-9893-4151-bee6-37c76fd537d0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:08.943973 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b545c93-9893-4151-bee6-37c76fd537d0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:08.944746 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b545c93-9893-4151-bee6-37c76fd537d0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:08.945209 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0b545c93-9893-4151-bee6-37c76fd537d0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:08.954886 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:40:08.956947 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70916f49-fc72-42b6-9465-2a4ebb3be045',volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:40:09.375153 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8653a04f-667e-476e-bbef-bde8b25ad7e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.038460 Jul 20 11:40:09.380970 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 260/530] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:40:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:40:09.385470 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dd96cf67-4d5b-478e-bb3c-4aab73609d93 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:09.386067 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dd96cf67-4d5b-478e-bb3c-4aab73609d93 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:09.446988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd96cf67-4d5b-478e-bb3c-4aab73609d93 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:09.456938 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dd96cf67-4d5b-478e-bb3c-4aab73609d93 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1089 microversion: 2.1 time: 0.075010 Jul 20 11:40:09.457559 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 261/531] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:09 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:09.703407 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=6 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:09.858009 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0b545c93-9893-4151-bee6-37c76fd537d0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "POST /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.926517 Jul 20 11:40:09.861419 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 271/532] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:40:08 2022] POST /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616/os-volume_attachments => generated 194 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:09.946919 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a75e6c1-6fac-4f3d-a2ce-f38f2d9cc169 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:09.947534 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a75e6c1-6fac-4f3d-a2ce-f38f2d9cc169 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:09.954316 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a75e6c1-6fac-4f3d-a2ce-f38f2d9cc169 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:09.954856 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a75e6c1-6fac-4f3d-a2ce-f38f2d9cc169 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:09.955804 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a75e6c1-6fac-4f3d-a2ce-f38f2d9cc169 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:09.956413 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a75e6c1-6fac-4f3d-a2ce-f38f2d9cc169 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:10.099918 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a75e6c1-6fac-4f3d-a2ce-f38f2d9cc169 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:10.107674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a75e6c1-6fac-4f3d-a2ce-f38f2d9cc169 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1366 microversion: 2.1 time: 0.164760 Jul 20 11:40:10.108314 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 262/533] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:09 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:10.475127 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee5fc300-cc2d-46bd-8a93-e20917a1cece tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:10.475959 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ee5fc300-cc2d-46bd-8a93-e20917a1cece tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:10.482367 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee5fc300-cc2d-46bd-8a93-e20917a1cece tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:10.482822 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee5fc300-cc2d-46bd-8a93-e20917a1cece tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:10.483718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee5fc300-cc2d-46bd-8a93-e20917a1cece tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:10.484669 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee5fc300-cc2d-46bd-8a93-e20917a1cece tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:10.549968 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee5fc300-cc2d-46bd-8a93-e20917a1cece tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:10.557518 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee5fc300-cc2d-46bd-8a93-e20917a1cece tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1139 microversion: 2.1 time: 0.087395 Jul 20 11:40:10.558080 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 272/534] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:10 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:11.123798 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b6204f12-d0ad-48fd-8aab-f75982bb056d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:11.124353 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b6204f12-d0ad-48fd-8aab-f75982bb056d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:11.131113 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6204f12-d0ad-48fd-8aab-f75982bb056d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:11.131579 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6204f12-d0ad-48fd-8aab-f75982bb056d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:11.132504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6204f12-d0ad-48fd-8aab-f75982bb056d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:11.133095 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6204f12-d0ad-48fd-8aab-f75982bb056d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:11.264210 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b6204f12-d0ad-48fd-8aab-f75982bb056d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:11.272090 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b6204f12-d0ad-48fd-8aab-f75982bb056d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1366 microversion: 2.1 time: 0.152296 Jul 20 11:40:11.272646 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 263/535] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:11 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:11.575043 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cb8b5fd7-4a86-4712-a138-dbbccc7595ef tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:11.575653 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cb8b5fd7-4a86-4712-a138-dbbccc7595ef tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:11.582858 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb8b5fd7-4a86-4712-a138-dbbccc7595ef tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:11.583306 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb8b5fd7-4a86-4712-a138-dbbccc7595ef tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:11.584070 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb8b5fd7-4a86-4712-a138-dbbccc7595ef tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:11.584509 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cb8b5fd7-4a86-4712-a138-dbbccc7595ef tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:11.645407 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cb8b5fd7-4a86-4712-a138-dbbccc7595ef tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:11.652690 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cb8b5fd7-4a86-4712-a138-dbbccc7595ef tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1187 microversion: 2.1 time: 0.081458 Jul 20 11:40:11.653286 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 273/536] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:11 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1187 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:12.289800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d67cd8ca-8e8c-4321-8967-604022db6119 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:12.290532 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d67cd8ca-8e8c-4321-8967-604022db6119 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:12.298011 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d67cd8ca-8e8c-4321-8967-604022db6119 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:12.298486 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d67cd8ca-8e8c-4321-8967-604022db6119 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:12.299268 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d67cd8ca-8e8c-4321-8967-604022db6119 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:12.299704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d67cd8ca-8e8c-4321-8967-604022db6119 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:12.397541 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-e888a4bb-f6ca-4359-8234-a8a789d8450f req-8bfd7384-37a4-4bad-82f7-35500a8c1394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd4c8483-4de8-465a-8214-90e2f2b77081", "name": "network-vif-plugged", "status": "completed", "tag": "9fb4e847-dc3d-4d4f-a6da-3e3b572e6708"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:12.413002 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e888a4bb-f6ca-4359-8234-a8a789d8450f req-8bfd7384-37a4-4bad-82f7-35500a8c1394 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:12.413445 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e888a4bb-f6ca-4359-8234-a8a789d8450f req-8bfd7384-37a4-4bad-82f7-35500a8c1394 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:12.426774 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-e888a4bb-f6ca-4359-8234-a8a789d8450f req-8bfd7384-37a4-4bad-82f7-35500a8c1394 service nova] Creating event network-vif-plugged:9fb4e847-dc3d-4d4f-a6da-3e3b572e6708 for instance fd4c8483-4de8-465a-8214-90e2f2b77081 on hv-cinder-82282 Jul 20 11:40:12.432130 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-e888a4bb-f6ca-4359-8234-a8a789d8450f req-8bfd7384-37a4-4bad-82f7-35500a8c1394 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038261 Jul 20 11:40:12.436580 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 274/537] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:40:12.444212 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d67cd8ca-8e8c-4321-8967-604022db6119 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:12.452298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d67cd8ca-8e8c-4321-8967-604022db6119 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1366 microversion: 2.1 time: 0.166665 Jul 20 11:40:12.453155 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 264/538] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:12 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:12.676494 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-45a40e4a-5f14-4f16-87f8-cbdff41de832 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:12.677432 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-45a40e4a-5f14-4f16-87f8-cbdff41de832 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:12.684333 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45a40e4a-5f14-4f16-87f8-cbdff41de832 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:12.684795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45a40e4a-5f14-4f16-87f8-cbdff41de832 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:12.685620 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45a40e4a-5f14-4f16-87f8-cbdff41de832 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:12.686062 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45a40e4a-5f14-4f16-87f8-cbdff41de832 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:12.886905 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-45a40e4a-5f14-4f16-87f8-cbdff41de832 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:12.898475 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-45a40e4a-5f14-4f16-87f8-cbdff41de832 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1273 microversion: 2.1 time: 0.224120 Jul 20 11:40:12.898475 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 275/539] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:12 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:13.469338 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-449e6e38-f004-4ad4-be8e-b01e93cb5438 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:13.470086 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-449e6e38-f004-4ad4-be8e-b01e93cb5438 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:13.476769 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-449e6e38-f004-4ad4-be8e-b01e93cb5438 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:13.477270 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-449e6e38-f004-4ad4-be8e-b01e93cb5438 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:13.478098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-449e6e38-f004-4ad4-be8e-b01e93cb5438 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:13.478442 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-449e6e38-f004-4ad4-be8e-b01e93cb5438 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:13.561808 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-44be380f-8c1a-4718-8f48-e801c09f828b req-eed9640a-d0ee-4eb6-9706-6425763b9f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eed301b-e35c-451d-931b-d25233e890f7", "tag": "4beedb58-67b0-40d2-ab20-ba7385d750c0"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:13.574208 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-44be380f-8c1a-4718-8f48-e801c09f828b req-eed9640a-d0ee-4eb6-9706-6425763b9f66 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:13.574208 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-44be380f-8c1a-4718-8f48-e801c09f828b req-eed9640a-d0ee-4eb6-9706-6425763b9f66 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:13.593337 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-44be380f-8c1a-4718-8f48-e801c09f828b req-eed9640a-d0ee-4eb6-9706-6425763b9f66 service nova] Creating event network-changed:4beedb58-67b0-40d2-ab20-ba7385d750c0 for instance 1eed301b-e35c-451d-931b-d25233e890f7 on hv-cinder-82282 Jul 20 11:40:13.598975 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-44be380f-8c1a-4718-8f48-e801c09f828b req-eed9640a-d0ee-4eb6-9706-6425763b9f66 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042006 Jul 20 11:40:13.599767 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 276/540] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:13.639874 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-449e6e38-f004-4ad4-be8e-b01e93cb5438 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:13.647831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-449e6e38-f004-4ad4-be8e-b01e93cb5438 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1366 microversion: 2.1 time: 0.182275 Jul 20 11:40:13.648730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 265/541] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:13 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:13.914417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d8945aae-4a7c-4d95-95ca-78575016a7f9 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:13.915160 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d8945aae-4a7c-4d95-95ca-78575016a7f9 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:13.922628 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8945aae-4a7c-4d95-95ca-78575016a7f9 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:13.923067 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8945aae-4a7c-4d95-95ca-78575016a7f9 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:13.923820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8945aae-4a7c-4d95-95ca-78575016a7f9 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:13.924249 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d8945aae-4a7c-4d95-95ca-78575016a7f9 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:14.054880 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d8945aae-4a7c-4d95-95ca-78575016a7f9 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:14.062378 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d8945aae-4a7c-4d95-95ca-78575016a7f9 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1273 microversion: 2.1 time: 0.152072 Jul 20 11:40:14.062972 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 277/542] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:13 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:14.665573 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56d90f19-ea2a-4ff7-959d-4206f394d866 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:14.666205 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56d90f19-ea2a-4ff7-959d-4206f394d866 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:14.672865 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56d90f19-ea2a-4ff7-959d-4206f394d866 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:14.673308 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56d90f19-ea2a-4ff7-959d-4206f394d866 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:14.674067 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56d90f19-ea2a-4ff7-959d-4206f394d866 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:14.674495 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56d90f19-ea2a-4ff7-959d-4206f394d866 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:14.971584 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56d90f19-ea2a-4ff7-959d-4206f394d866 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:14.979175 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56d90f19-ea2a-4ff7-959d-4206f394d866 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1366 microversion: 2.1 time: 0.317369 Jul 20 11:40:14.979838 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 266/543] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:14 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:15.078909 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-64a5d015-23cb-4ec3-8b28-e5f1bcc00d7b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:15.079515 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-64a5d015-23cb-4ec3-8b28-e5f1bcc00d7b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:15.086038 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64a5d015-23cb-4ec3-8b28-e5f1bcc00d7b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:15.086522 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64a5d015-23cb-4ec3-8b28-e5f1bcc00d7b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:15.087282 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64a5d015-23cb-4ec3-8b28-e5f1bcc00d7b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:15.087715 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64a5d015-23cb-4ec3-8b28-e5f1bcc00d7b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:15.230749 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-64a5d015-23cb-4ec3-8b28-e5f1bcc00d7b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:15.238736 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-64a5d015-23cb-4ec3-8b28-e5f1bcc00d7b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1273 microversion: 2.1 time: 0.163666 Jul 20 11:40:15.239390 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 278/544] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:15 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:15.996621 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c3d3be6d-3627-443b-9021-f29d51ae0021 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:15.997261 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c3d3be6d-3627-443b-9021-f29d51ae0021 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:16.004126 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3d3be6d-3627-443b-9021-f29d51ae0021 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:16.004565 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3d3be6d-3627-443b-9021-f29d51ae0021 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:16.005349 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3d3be6d-3627-443b-9021-f29d51ae0021 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:16.005780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c3d3be6d-3627-443b-9021-f29d51ae0021 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:16.141458 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c3d3be6d-3627-443b-9021-f29d51ae0021 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:16.148810 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c3d3be6d-3627-443b-9021-f29d51ae0021 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1366 microversion: 2.1 time: 0.155959 Jul 20 11:40:16.149386 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 267/545] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:15 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:16.255628 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-08a2bfbe-688a-4daa-90bd-071657f3d749 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:16.256228 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-08a2bfbe-688a-4daa-90bd-071657f3d749 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:16.262892 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08a2bfbe-688a-4daa-90bd-071657f3d749 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:16.263336 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08a2bfbe-688a-4daa-90bd-071657f3d749 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:16.264095 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08a2bfbe-688a-4daa-90bd-071657f3d749 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:16.264526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-08a2bfbe-688a-4daa-90bd-071657f3d749 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:16.396229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-08a2bfbe-688a-4daa-90bd-071657f3d749 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:16.403471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-08a2bfbe-688a-4daa-90bd-071657f3d749 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1273 microversion: 2.1 time: 0.151640 Jul 20 11:40:16.404032 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 279/546] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:16 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:17.165105 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b156cc57-28ef-42a1-b353-ba49bc171103 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:17.165712 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b156cc57-28ef-42a1-b353-ba49bc171103 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:17.172827 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b156cc57-28ef-42a1-b353-ba49bc171103 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:17.173276 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b156cc57-28ef-42a1-b353-ba49bc171103 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:17.174038 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b156cc57-28ef-42a1-b353-ba49bc171103 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:17.174467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b156cc57-28ef-42a1-b353-ba49bc171103 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:17.300129 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b156cc57-28ef-42a1-b353-ba49bc171103 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:17.307772 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b156cc57-28ef-42a1-b353-ba49bc171103 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1555 microversion: 2.1 time: 0.146513 Jul 20 11:40:17.308347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 268/547] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:17 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:17.324132 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bf253fc8-fa6a-407d-b67e-a645c7581d59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:17.324629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bf253fc8-fa6a-407d-b67e-a645c7581d59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:17.330933 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf253fc8-fa6a-407d-b67e-a645c7581d59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:17.331376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf253fc8-fa6a-407d-b67e-a645c7581d59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:17.332135 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf253fc8-fa6a-407d-b67e-a645c7581d59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:17.332566 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf253fc8-fa6a-407d-b67e-a645c7581d59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:17.420658 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0c84a4c0-719b-4dcd-8897-21f298b8af62 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:17.421218 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0c84a4c0-719b-4dcd-8897-21f298b8af62 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:17.427970 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c84a4c0-719b-4dcd-8897-21f298b8af62 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:17.428411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c84a4c0-719b-4dcd-8897-21f298b8af62 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:17.429206 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c84a4c0-719b-4dcd-8897-21f298b8af62 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:17.429636 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0c84a4c0-719b-4dcd-8897-21f298b8af62 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:17.457919 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bf253fc8-fa6a-407d-b67e-a645c7581d59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137513 Jul 20 11:40:17.472763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 280/548] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 11:40:17 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:17.694929 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0c84a4c0-719b-4dcd-8897-21f298b8af62 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:17.702343 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0c84a4c0-719b-4dcd-8897-21f298b8af62 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1273 microversion: 2.1 time: 0.285582 Jul 20 11:40:17.702913 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 269/549] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:17 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1273 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:40:18.719683 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9b831fe-605b-4415-bc59-2954298bb9d2 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:18.720983 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9b831fe-605b-4415-bc59-2954298bb9d2 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:18.726975 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9b831fe-605b-4415-bc59-2954298bb9d2 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:18.727434 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9b831fe-605b-4415-bc59-2954298bb9d2 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:18.728210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9b831fe-605b-4415-bc59-2954298bb9d2 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:18.728661 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9b831fe-605b-4415-bc59-2954298bb9d2 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:18.784476 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-602b207c-2ff4-4229-8bc0-1fa5f956cce7 req-e36ca084-a2a9-4fe1-aadd-bfce93e5f425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd4c8483-4de8-465a-8214-90e2f2b77081", "tag": "9fb4e847-dc3d-4d4f-a6da-3e3b572e6708"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:18.793988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-602b207c-2ff4-4229-8bc0-1fa5f956cce7 req-e36ca084-a2a9-4fe1-aadd-bfce93e5f425 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:18.794434 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-602b207c-2ff4-4229-8bc0-1fa5f956cce7 req-e36ca084-a2a9-4fe1-aadd-bfce93e5f425 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:18.811373 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-602b207c-2ff4-4229-8bc0-1fa5f956cce7 req-e36ca084-a2a9-4fe1-aadd-bfce93e5f425 service nova] Creating event network-changed:9fb4e847-dc3d-4d4f-a6da-3e3b572e6708 for instance fd4c8483-4de8-465a-8214-90e2f2b77081 on hv-cinder-82282 Jul 20 11:40:18.814548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-602b207c-2ff4-4229-8bc0-1fa5f956cce7 req-e36ca084-a2a9-4fe1-aadd-bfce93e5f425 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036205 Jul 20 11:40:18.815423 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 270/550] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:40:18.908603 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e9b831fe-605b-4415-bc59-2954298bb9d2 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:18.918508 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9b831fe-605b-4415-bc59-2954298bb9d2 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1273 microversion: 2.1 time: 0.203257 Jul 20 11:40:18.919331 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 281/551] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:18 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:19.932835 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:19.933686 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=14 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:19.938931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-13b88ac8-fc1d-4af8-a69a-9997d009dbfb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:19.939626 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-13b88ac8-fc1d-4af8-a69a-9997d009dbfb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:19.945927 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13b88ac8-fc1d-4af8-a69a-9997d009dbfb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:19.946377 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13b88ac8-fc1d-4af8-a69a-9997d009dbfb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:19.947168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13b88ac8-fc1d-4af8-a69a-9997d009dbfb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:19.947602 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13b88ac8-fc1d-4af8-a69a-9997d009dbfb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:20.096100 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-13b88ac8-fc1d-4af8-a69a-9997d009dbfb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:20.103608 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-13b88ac8-fc1d-4af8-a69a-9997d009dbfb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1273 microversion: 2.1 time: 0.171772 Jul 20 11:40:20.104180 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 271/552] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:19 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:21.119955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9458f88f-84e7-4327-a101-ad3e8548f01f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:21.120488 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9458f88f-84e7-4327-a101-ad3e8548f01f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:21.126994 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9458f88f-84e7-4327-a101-ad3e8548f01f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:21.127440 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9458f88f-84e7-4327-a101-ad3e8548f01f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:21.128201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9458f88f-84e7-4327-a101-ad3e8548f01f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:21.128634 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9458f88f-84e7-4327-a101-ad3e8548f01f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:21.259549 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9458f88f-84e7-4327-a101-ad3e8548f01f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:21.263002 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:21.267960 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9458f88f-84e7-4327-a101-ad3e8548f01f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.151808 Jul 20 11:40:21.268518 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 282/553] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:21 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:22.285600 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-370db36e-1ad5-4666-a60f-0a254b9351f8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:22.286203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-370db36e-1ad5-4666-a60f-0a254b9351f8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:22.293301 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-370db36e-1ad5-4666-a60f-0a254b9351f8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:22.293742 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-370db36e-1ad5-4666-a60f-0a254b9351f8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:22.294494 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-370db36e-1ad5-4666-a60f-0a254b9351f8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:22.294922 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-370db36e-1ad5-4666-a60f-0a254b9351f8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:22.425883 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-370db36e-1ad5-4666-a60f-0a254b9351f8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:22.433332 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-370db36e-1ad5-4666-a60f-0a254b9351f8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.151941 Jul 20 11:40:22.433893 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 272/554] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:22 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:23.450100 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-308eb126-a137-4f62-a6cc-a604e66039a8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:23.450705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-308eb126-a137-4f62-a6cc-a604e66039a8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:23.458073 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-308eb126-a137-4f62-a6cc-a604e66039a8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:23.458523 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-308eb126-a137-4f62-a6cc-a604e66039a8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:23.459282 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-308eb126-a137-4f62-a6cc-a604e66039a8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:23.459718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-308eb126-a137-4f62-a6cc-a604e66039a8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:23.587508 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-308eb126-a137-4f62-a6cc-a604e66039a8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:23.594972 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-308eb126-a137-4f62-a6cc-a604e66039a8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.148996 Jul 20 11:40:23.595540 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 283/555] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:23 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:24.612296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-744fb894-a9ac-4e02-93c3-9c27305fcb1c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:24.612914 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-744fb894-a9ac-4e02-93c3-9c27305fcb1c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:24.619361 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-744fb894-a9ac-4e02-93c3-9c27305fcb1c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:24.619808 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-744fb894-a9ac-4e02-93c3-9c27305fcb1c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:24.620571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-744fb894-a9ac-4e02-93c3-9c27305fcb1c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:24.621035 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-744fb894-a9ac-4e02-93c3-9c27305fcb1c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:24.754382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-744fb894-a9ac-4e02-93c3-9c27305fcb1c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:24.762555 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-744fb894-a9ac-4e02-93c3-9c27305fcb1c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.154022 Jul 20 11:40:24.763302 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 273/556] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:24 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:25.779684 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d467ef86-6531-4326-82d6-855619b2dab6 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:25.780296 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d467ef86-6531-4326-82d6-855619b2dab6 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:25.787339 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d467ef86-6531-4326-82d6-855619b2dab6 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:25.787788 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d467ef86-6531-4326-82d6-855619b2dab6 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:25.788553 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d467ef86-6531-4326-82d6-855619b2dab6 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:25.789017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d467ef86-6531-4326-82d6-855619b2dab6 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:25.919046 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d467ef86-6531-4326-82d6-855619b2dab6 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:25.926499 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d467ef86-6531-4326-82d6-855619b2dab6 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.150645 Jul 20 11:40:25.927055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 284/557] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:25 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:26.943287 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-114497f1-620d-4874-9ecc-11ac4a5adefa tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:26.943887 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-114497f1-620d-4874-9ecc-11ac4a5adefa tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:26.950435 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-114497f1-620d-4874-9ecc-11ac4a5adefa tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:26.950879 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-114497f1-620d-4874-9ecc-11ac4a5adefa tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:26.951753 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-114497f1-620d-4874-9ecc-11ac4a5adefa tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:26.952188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-114497f1-620d-4874-9ecc-11ac4a5adefa tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:26.970726 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:27.091964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-114497f1-620d-4874-9ecc-11ac4a5adefa tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:27.100201 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-114497f1-620d-4874-9ecc-11ac4a5adefa tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.160926 Jul 20 11:40:27.100773 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 274/558] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:26 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:28.116486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-258c4b3c-4b60-48d4-9b75-26713fd45b7f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:28.117132 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-258c4b3c-4b60-48d4-9b75-26713fd45b7f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:28.119416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:28.124147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-258c4b3c-4b60-48d4-9b75-26713fd45b7f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:28.124590 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-258c4b3c-4b60-48d4-9b75-26713fd45b7f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:28.125378 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-258c4b3c-4b60-48d4-9b75-26713fd45b7f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:28.126352 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-258c4b3c-4b60-48d4-9b75-26713fd45b7f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:28.257177 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-258c4b3c-4b60-48d4-9b75-26713fd45b7f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:28.264577 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-258c4b3c-4b60-48d4-9b75-26713fd45b7f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.151959 Jul 20 11:40:28.265167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 285/559] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:28 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:29.282103 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-41eaf4b3-2267-4856-8639-cfc50a20a487 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:29.282716 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-41eaf4b3-2267-4856-8639-cfc50a20a487 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:29.285074 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:29.289811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-41eaf4b3-2267-4856-8639-cfc50a20a487 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:29.290261 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-41eaf4b3-2267-4856-8639-cfc50a20a487 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:29.291043 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-41eaf4b3-2267-4856-8639-cfc50a20a487 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:29.291468 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-41eaf4b3-2267-4856-8639-cfc50a20a487 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:29.424421 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-41eaf4b3-2267-4856-8639-cfc50a20a487 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:29.431820 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-41eaf4b3-2267-4856-8639-cfc50a20a487 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.153580 Jul 20 11:40:29.432386 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 275/560] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:29 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:30.448537 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-adff372f-0c20-4316-baba-05d92f8108e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:30.449119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-adff372f-0c20-4316-baba-05d92f8108e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:30.456135 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adff372f-0c20-4316-baba-05d92f8108e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:30.456571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adff372f-0c20-4316-baba-05d92f8108e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:30.457353 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adff372f-0c20-4316-baba-05d92f8108e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:30.457781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-adff372f-0c20-4316-baba-05d92f8108e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:30.589671 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-adff372f-0c20-4316-baba-05d92f8108e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:30.597057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-adff372f-0c20-4316-baba-05d92f8108e3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.152330 Jul 20 11:40:30.597626 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 286/561] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:30 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:31.614648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-70e4edba-5dee-4e17-a71f-967abb34ee16 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:31.615250 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-70e4edba-5dee-4e17-a71f-967abb34ee16 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:31.621697 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70e4edba-5dee-4e17-a71f-967abb34ee16 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:31.622137 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70e4edba-5dee-4e17-a71f-967abb34ee16 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:31.622885 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70e4edba-5dee-4e17-a71f-967abb34ee16 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:31.623313 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70e4edba-5dee-4e17-a71f-967abb34ee16 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:31.752378 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-70e4edba-5dee-4e17-a71f-967abb34ee16 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:31.759722 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-70e4edba-5dee-4e17-a71f-967abb34ee16 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.149563 Jul 20 11:40:31.760279 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 276/562] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:31 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:32.776464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-80d1bf01-68d5-46f7-a0d3-94922670ef65 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:32.777098 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-80d1bf01-68d5-46f7-a0d3-94922670ef65 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:32.783619 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80d1bf01-68d5-46f7-a0d3-94922670ef65 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:32.784628 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80d1bf01-68d5-46f7-a0d3-94922670ef65 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:32.785426 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80d1bf01-68d5-46f7-a0d3-94922670ef65 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:32.785864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80d1bf01-68d5-46f7-a0d3-94922670ef65 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:32.942511 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-80d1bf01-68d5-46f7-a0d3-94922670ef65 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:32.950105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-80d1bf01-68d5-46f7-a0d3-94922670ef65 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.177369 Jul 20 11:40:32.950656 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 287/563] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:32 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:33.967279 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3e632165-f478-4201-8a87-dc2cf4648d1e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:33.967888 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3e632165-f478-4201-8a87-dc2cf4648d1e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:33.974944 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e632165-f478-4201-8a87-dc2cf4648d1e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:33.975385 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e632165-f478-4201-8a87-dc2cf4648d1e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:33.976144 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e632165-f478-4201-8a87-dc2cf4648d1e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:33.976573 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e632165-f478-4201-8a87-dc2cf4648d1e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:34.112222 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3e632165-f478-4201-8a87-dc2cf4648d1e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:34.120765 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3e632165-f478-4201-8a87-dc2cf4648d1e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.157268 Jul 20 11:40:34.126145 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 277/564] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:33 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:35.139571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3321d900-d422-4bca-adc8-02bf0aa3290e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:35.140276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3321d900-d422-4bca-adc8-02bf0aa3290e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:35.147571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3321d900-d422-4bca-adc8-02bf0aa3290e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:35.147956 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3321d900-d422-4bca-adc8-02bf0aa3290e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:35.148726 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3321d900-d422-4bca-adc8-02bf0aa3290e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:35.149196 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3321d900-d422-4bca-adc8-02bf0aa3290e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:35.281877 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3321d900-d422-4bca-adc8-02bf0aa3290e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:35.289733 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3321d900-d422-4bca-adc8-02bf0aa3290e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.153973 Jul 20 11:40:35.290299 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 288/565] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:35 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:36.306286 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-890ab718-ac52-4a80-92ca-c405b3f7d278 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:36.306898 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-890ab718-ac52-4a80-92ca-c405b3f7d278 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:36.313020 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-890ab718-ac52-4a80-92ca-c405b3f7d278 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:36.313466 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-890ab718-ac52-4a80-92ca-c405b3f7d278 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:36.314226 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-890ab718-ac52-4a80-92ca-c405b3f7d278 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:36.314660 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-890ab718-ac52-4a80-92ca-c405b3f7d278 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:36.442712 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-890ab718-ac52-4a80-92ca-c405b3f7d278 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:36.450073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-890ab718-ac52-4a80-92ca-c405b3f7d278 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.147677 Jul 20 11:40:36.450640 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 278/566] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:36 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:37.466907 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-43d7f39d-4e38-4ddb-bb5e-c2aee48891da tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:37.467450 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-43d7f39d-4e38-4ddb-bb5e-c2aee48891da tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:37.473808 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43d7f39d-4e38-4ddb-bb5e-c2aee48891da tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:37.474249 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43d7f39d-4e38-4ddb-bb5e-c2aee48891da tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:37.475005 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43d7f39d-4e38-4ddb-bb5e-c2aee48891da tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:37.475435 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-43d7f39d-4e38-4ddb-bb5e-c2aee48891da tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:37.603590 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-43d7f39d-4e38-4ddb-bb5e-c2aee48891da tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:37.610933 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-43d7f39d-4e38-4ddb-bb5e-c2aee48891da tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.148319 Jul 20 11:40:37.611490 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 289/567] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:37 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:38.627300 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c1d17858-43ed-40f3-9746-b9f65491d7a7 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:38.627910 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c1d17858-43ed-40f3-9746-b9f65491d7a7 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:38.634501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1d17858-43ed-40f3-9746-b9f65491d7a7 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:38.634948 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1d17858-43ed-40f3-9746-b9f65491d7a7 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:38.635719 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1d17858-43ed-40f3-9746-b9f65491d7a7 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:38.636143 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c1d17858-43ed-40f3-9746-b9f65491d7a7 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:38.767741 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c1d17858-43ed-40f3-9746-b9f65491d7a7 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:38.775607 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c1d17858-43ed-40f3-9746-b9f65491d7a7 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.152162 Jul 20 11:40:38.776169 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 279/568] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:38 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:39.791753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-488aaad5-daaa-4060-81c2-b10a8458cff8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:39.792388 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-488aaad5-daaa-4060-81c2-b10a8458cff8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:39.798479 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-488aaad5-daaa-4060-81c2-b10a8458cff8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:39.798927 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-488aaad5-daaa-4060-81c2-b10a8458cff8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:39.799746 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-488aaad5-daaa-4060-81c2-b10a8458cff8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:39.800178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-488aaad5-daaa-4060-81c2-b10a8458cff8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:39.934052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-488aaad5-daaa-4060-81c2-b10a8458cff8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:39.941973 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-488aaad5-daaa-4060-81c2-b10a8458cff8 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.153732 Jul 20 11:40:39.942536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 290/569] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:39 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:40.958946 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8369aceb-a046-40af-9ffc-34c2f567d9e1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:40.959916 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8369aceb-a046-40af-9ffc-34c2f567d9e1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:40.968289 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8369aceb-a046-40af-9ffc-34c2f567d9e1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:40.973260 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8369aceb-a046-40af-9ffc-34c2f567d9e1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:40.973260 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8369aceb-a046-40af-9ffc-34c2f567d9e1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:40.973260 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8369aceb-a046-40af-9ffc-34c2f567d9e1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:41.104930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8369aceb-a046-40af-9ffc-34c2f567d9e1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:41.112293 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8369aceb-a046-40af-9ffc-34c2f567d9e1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.158202 Jul 20 11:40:41.112879 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 280/570] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:40 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:42.137662 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-02e7e205-a30a-4552-becf-fcd1d38242c4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:42.137662 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-02e7e205-a30a-4552-becf-fcd1d38242c4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:42.144319 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02e7e205-a30a-4552-becf-fcd1d38242c4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:42.144762 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02e7e205-a30a-4552-becf-fcd1d38242c4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:42.145553 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02e7e205-a30a-4552-becf-fcd1d38242c4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:42.145989 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-02e7e205-a30a-4552-becf-fcd1d38242c4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:42.274681 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-2f2406fe-fd16-41ff-8618-d24df570faca req-8f5635f5-7ea6-4378-b460-3882ccb12da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eed301b-e35c-451d-931b-d25233e890f7", "name": "network-vif-plugged", "status": "completed", "tag": "4beedb58-67b0-40d2-ab20-ba7385d750c0"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:42.285742 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2f2406fe-fd16-41ff-8618-d24df570faca req-8f5635f5-7ea6-4378-b460-3882ccb12da3 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:42.286258 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2f2406fe-fd16-41ff-8618-d24df570faca req-8f5635f5-7ea6-4378-b460-3882ccb12da3 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:42.296888 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-02e7e205-a30a-4552-becf-fcd1d38242c4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:42.297966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-2f2406fe-fd16-41ff-8618-d24df570faca req-8f5635f5-7ea6-4378-b460-3882ccb12da3 service nova] Creating event network-vif-plugged:4beedb58-67b0-40d2-ab20-ba7385d750c0 for instance 1eed301b-e35c-451d-931b-d25233e890f7 on hv-cinder-82282 Jul 20 11:40:42.303755 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-2f2406fe-fd16-41ff-8618-d24df570faca req-8f5635f5-7ea6-4378-b460-3882ccb12da3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032618 Jul 20 11:40:42.304822 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 281/571] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:40:42.305055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-02e7e205-a30a-4552-becf-fcd1d38242c4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.172200 Jul 20 11:40:42.309368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 291/572] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:42 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:43.322215 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0ec463a9-3c0b-4364-9279-523edb766f41 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:43.322901 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0ec463a9-3c0b-4364-9279-523edb766f41 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:43.329941 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ec463a9-3c0b-4364-9279-523edb766f41 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:43.330381 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ec463a9-3c0b-4364-9279-523edb766f41 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:43.331423 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ec463a9-3c0b-4364-9279-523edb766f41 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:43.331600 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ec463a9-3c0b-4364-9279-523edb766f41 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:43.468241 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0ec463a9-3c0b-4364-9279-523edb766f41 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:43.476685 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0ec463a9-3c0b-4364-9279-523edb766f41 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.158688 Jul 20 11:40:43.477274 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 282/573] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:43 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:43.810752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3685e8b7-4d9d-4c80-96e5-07d83ba5326b tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:43.811369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3685e8b7-4d9d-4c80-96e5-07d83ba5326b tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:43.818171 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3685e8b7-4d9d-4c80-96e5-07d83ba5326b tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:43.821139 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3685e8b7-4d9d-4c80-96e5-07d83ba5326b tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:43.821139 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3685e8b7-4d9d-4c80-96e5-07d83ba5326b tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:43.821139 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3685e8b7-4d9d-4c80-96e5-07d83ba5326b tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:43.947820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-3685e8b7-4d9d-4c80-96e5-07d83ba5326b tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lazy-loading 'services' on Instance uuid f8d15bd2-8390-4ee1-a0b8-02e575741616 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:40:44.283158 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3685e8b7-4d9d-4c80-96e5-07d83ba5326b tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616/os-volume_attachments/918f09fd-6d50-481e-9a84-3ae650cc1607" status: 202 len: 0 microversion: 2.1 time: 0.476111 Jul 20 11:40:44.284037 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 292/574] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 11:40:43 2022] DELETE /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616/os-volume_attachments/918f09fd-6d50-481e-9a84-3ae650cc1607 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:40:44.493664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-432d705c-a7ae-42d3-b548-9565ebfae462 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:44.494269 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-432d705c-a7ae-42d3-b548-9565ebfae462 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:44.504271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-432d705c-a7ae-42d3-b548-9565ebfae462 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:44.504271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-432d705c-a7ae-42d3-b548-9565ebfae462 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:44.504271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-432d705c-a7ae-42d3-b548-9565ebfae462 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:44.504271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-432d705c-a7ae-42d3-b548-9565ebfae462 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:44.658605 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-432d705c-a7ae-42d3-b548-9565ebfae462 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:44.670140 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-432d705c-a7ae-42d3-b548-9565ebfae462 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1261 microversion: 2.1 time: 0.180780 Jul 20 11:40:44.670730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 283/575] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:44 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:45.688188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eb19c8d3-9006-4fe2-adb2-48b9de8c22e4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:45.688917 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eb19c8d3-9006-4fe2-adb2-48b9de8c22e4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:45.695752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb19c8d3-9006-4fe2-adb2-48b9de8c22e4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:45.696192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb19c8d3-9006-4fe2-adb2-48b9de8c22e4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:45.696991 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb19c8d3-9006-4fe2-adb2-48b9de8c22e4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:45.697427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb19c8d3-9006-4fe2-adb2-48b9de8c22e4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:45.831027 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb19c8d3-9006-4fe2-adb2-48b9de8c22e4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:45.838756 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eb19c8d3-9006-4fe2-adb2-48b9de8c22e4 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1445 microversion: 2.1 time: 0.155226 Jul 20 11:40:45.839739 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 293/576] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:45 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:45.855665 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-265519df-53f3-4b61-a7ef-fe6653819537 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:45.856271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-265519df-53f3-4b61-a7ef-fe6653819537 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:45.862918 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-265519df-53f3-4b61-a7ef-fe6653819537 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:45.863439 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-265519df-53f3-4b61-a7ef-fe6653819537 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:45.864218 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-265519df-53f3-4b61-a7ef-fe6653819537 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:45.864669 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-265519df-53f3-4b61-a7ef-fe6653819537 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:46.013860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-265519df-53f3-4b61-a7ef-fe6653819537 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:46.021667 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-265519df-53f3-4b61-a7ef-fe6653819537 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1445 microversion: 2.1 time: 0.169804 Jul 20 11:40:46.022240 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 284/577] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:45 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1445 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:47.520739 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a0c5b41a-5194-4df7-8294-bf0914401d65 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:47.521279 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a0c5b41a-5194-4df7-8294-bf0914401d65 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:47.527858 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0c5b41a-5194-4df7-8294-bf0914401d65 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:47.528304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0c5b41a-5194-4df7-8294-bf0914401d65 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:47.529094 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0c5b41a-5194-4df7-8294-bf0914401d65 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:47.529532 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0c5b41a-5194-4df7-8294-bf0914401d65 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:47.554997 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a0c5b41a-5194-4df7-8294-bf0914401d65 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:40:47.826431 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a0c5b41a-5194-4df7-8294-bf0914401d65 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 204 len: 0 microversion: 2.1 time: 0.309682 Jul 20 11:40:47.827027 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 294/578] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:40:47 2022] DELETE /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:40:47.836378 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f4a0ec6e-6202-4c6a-a037-78dc7d550908 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:47.836969 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f4a0ec6e-6202-4c6a-a037-78dc7d550908 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:47.843665 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4a0ec6e-6202-4c6a-a037-78dc7d550908 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:47.844048 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4a0ec6e-6202-4c6a-a037-78dc7d550908 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:47.844889 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4a0ec6e-6202-4c6a-a037-78dc7d550908 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:47.845327 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f4a0ec6e-6202-4c6a-a037-78dc7d550908 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:48.069557 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f4a0ec6e-6202-4c6a-a037-78dc7d550908 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:48.077234 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f4a0ec6e-6202-4c6a-a037-78dc7d550908 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1513 microversion: 2.1 time: 0.245641 Jul 20 11:40:48.077944 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 285/579] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:47 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:48.612281 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-93eedf1b-f1c6-46ea-a7b0-a01a2c0628c9 req-4d741f2b-302e-47c0-a6d7-64e13e85bd74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eed301b-e35c-451d-931b-d25233e890f7", "tag": "4beedb58-67b0-40d2-ab20-ba7385d750c0"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:48.620734 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-93eedf1b-f1c6-46ea-a7b0-a01a2c0628c9 req-4d741f2b-302e-47c0-a6d7-64e13e85bd74 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:48.621407 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-93eedf1b-f1c6-46ea-a7b0-a01a2c0628c9 req-4d741f2b-302e-47c0-a6d7-64e13e85bd74 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:48.632248 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-93eedf1b-f1c6-46ea-a7b0-a01a2c0628c9 req-4d741f2b-302e-47c0-a6d7-64e13e85bd74 service nova] Creating event network-changed:4beedb58-67b0-40d2-ab20-ba7385d750c0 for instance 1eed301b-e35c-451d-931b-d25233e890f7 on hv-cinder-82282 Jul 20 11:40:48.637973 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-93eedf1b-f1c6-46ea-a7b0-a01a2c0628c9 req-4d741f2b-302e-47c0-a6d7-64e13e85bd74 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028898 Jul 20 11:40:48.637973 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 295/580] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:49.095002 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b0e9a4b6-69b3-4fe8-90aa-e22b6e028171 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:49.095593 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b0e9a4b6-69b3-4fe8-90aa-e22b6e028171 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:49.103124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0e9a4b6-69b3-4fe8-90aa-e22b6e028171 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:49.103570 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0e9a4b6-69b3-4fe8-90aa-e22b6e028171 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:49.104349 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0e9a4b6-69b3-4fe8-90aa-e22b6e028171 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:49.104805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b0e9a4b6-69b3-4fe8-90aa-e22b6e028171 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:49.236463 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b0e9a4b6-69b3-4fe8-90aa-e22b6e028171 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:49.243923 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b0e9a4b6-69b3-4fe8-90aa-e22b6e028171 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1513 microversion: 2.1 time: 0.152998 Jul 20 11:40:49.244494 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 286/581] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:49 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:50.262111 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0acc0563-b9be-4bda-aa2a-06326d63893c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:50.262799 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0acc0563-b9be-4bda-aa2a-06326d63893c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:50.269233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0acc0563-b9be-4bda-aa2a-06326d63893c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:50.269672 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0acc0563-b9be-4bda-aa2a-06326d63893c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:50.270427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0acc0563-b9be-4bda-aa2a-06326d63893c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:50.270851 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0acc0563-b9be-4bda-aa2a-06326d63893c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:50.405057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0acc0563-b9be-4bda-aa2a-06326d63893c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:50.412490 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0acc0563-b9be-4bda-aa2a-06326d63893c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1513 microversion: 2.1 time: 0.155733 Jul 20 11:40:50.417915 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 296/582] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:50 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:51.016412 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-ba309746-b6c7-4f9b-8f33-44c315598f81 req-2c1f1ee8-668c-4bc8-aa9a-2b7a8856cf37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d15bd2-8390-4ee1-a0b8-02e575741616", "name": "network-vif-deleted", "tag": "d9d051e8-f987-44a1-be3a-edd9b1d46a9b"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:51.025389 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-ba309746-b6c7-4f9b-8f33-44c315598f81 req-2c1f1ee8-668c-4bc8-aa9a-2b7a8856cf37 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:51.025829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-ba309746-b6c7-4f9b-8f33-44c315598f81 req-2c1f1ee8-668c-4bc8-aa9a-2b7a8856cf37 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:51.036927 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-ba309746-b6c7-4f9b-8f33-44c315598f81 req-2c1f1ee8-668c-4bc8-aa9a-2b7a8856cf37 service nova] Creating event network-vif-deleted:d9d051e8-f987-44a1-be3a-edd9b1d46a9b for instance f8d15bd2-8390-4ee1-a0b8-02e575741616 on hv-cinder-82282 Jul 20 11:40:51.042571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-ba309746-b6c7-4f9b-8f33-44c315598f81 req-2c1f1ee8-668c-4bc8-aa9a-2b7a8856cf37 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155471 Jul 20 11:40:51.043473 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 287/583] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:51.430575 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6a3b8dce-5209-4f96-8f9b-b33f5ad0d85c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:51.431184 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6a3b8dce-5209-4f96-8f9b-b33f5ad0d85c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:51.437625 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a3b8dce-5209-4f96-8f9b-b33f5ad0d85c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:51.438066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a3b8dce-5209-4f96-8f9b-b33f5ad0d85c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:51.438821 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a3b8dce-5209-4f96-8f9b-b33f5ad0d85c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:51.439251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a3b8dce-5209-4f96-8f9b-b33f5ad0d85c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:51.468734 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a3b8dce-5209-4f96-8f9b-b33f5ad0d85c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:51.469211 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6a3b8dce-5209-4f96-8f9b-b33f5ad0d85c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:51.469652 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-6a3b8dce-5209-4f96-8f9b-b33f5ad0d85c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lazy-loading 'fault' on Instance uuid f8d15bd2-8390-4ee1-a0b8-02e575741616 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:40:51.472321 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:51.511813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6a3b8dce-5209-4f96-8f9b-b33f5ad0d85c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:51.519483 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6a3b8dce-5209-4f96-8f9b-b33f5ad0d85c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 200 len: 1309 microversion: 2.1 time: 0.093305 Jul 20 11:40:51.520043 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 297/584] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:51 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:52.538721 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-108230db-da9d-446a-a2bf-3bba6edadea6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:52.539411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-108230db-da9d-446a-a2bf-3bba6edadea6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: f8d15bd2-8390-4ee1-a0b8-02e575741616] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:52.545801 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-108230db-da9d-446a-a2bf-3bba6edadea6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:52.546489 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-108230db-da9d-446a-a2bf-3bba6edadea6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:52.547293 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-108230db-da9d-446a-a2bf-3bba6edadea6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:52.547766 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-108230db-da9d-446a-a2bf-3bba6edadea6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:52.561015 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-108230db-da9d-446a-a2bf-3bba6edadea6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] HTTP exception thrown: Instance f8d15bd2-8390-4ee1-a0b8-02e575741616 could not be found. Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-108230db-da9d-446a-a2bf-3bba6edadea6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Request method failure captured: Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 HTTP/1.1 Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-k9-sCuOfWzwE4c8VvSzhk9klsEGcoOykR2qNnH_Y9jI_PxG75_GcI-HD80DDXEAuyLRSCa9MWSpR1uYg8wcHzJ2fAQhq8u_hA2brQo1etxJCqON80dsZ-l44ATFoZ5GuD9RwhR83cN6p7yGPs6j48b1PB2eTsWm7f0kwNj9maBE0s Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: 6c3490e18f0c4312a4f7ee37db18344f Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1875259575 Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:40:52.562637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:40:52.564262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c3490e18f0c4312a4f7ee37db18344f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c3490e18f0c4312a4f7ee37db18344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c3490e18f0c4312a4f7ee37db18344f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c3490e18f0c4312a4f7ee37db18344f"}]}] Jul 20 11:40:52.564262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesSnapshotTestJSON-1875259575 Jul 20 11:40:52.564262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 6c3490e18f0c4312a4f7ee37db18344f Jul 20 11:40:52.564262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1875259575 Jul 20 11:40:52.564262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesSnapshotTestJSON-1875259575-project Jul 20 11:40:52.564262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:40:52.564262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:40:52.564262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 8c1fcfa9effd4d66ad1fef744393a04c Jul 20 11:40:52.564262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesSnapshotTestJSON-1875259575-project Jul 20 11:40:52.564262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:40:52.564262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance f8d15bd2-8390-4ee1-a0b8-02e575741616 could not be found. Jul 20 11:40:52.564262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'f8d15bd2-8390-4ee1-a0b8-02e575741616'} Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d15bd2-8390-4ee1-a0b8-02e575741616 could not be found. Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:40:52.565266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d15bd2-8390-4ee1-a0b8-02e575741616 could not be found. Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d15bd2-8390-4ee1-a0b8-02e575741616 could not be found. Jul 20 11:40:52.566740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:40:52.568073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-108230db-da9d-446a-a2bf-3bba6edadea6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Returning 404 to user: Instance f8d15bd2-8390-4ee1-a0b8-02e575741616 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:40:52.568073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-108230db-da9d-446a-a2bf-3bba6edadea6 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616" status: 404 len: 111 microversion: 2.1 time: 0.030580 Jul 20 11:40:52.568073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 288/585] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:52 2022] GET /compute/v2.1/servers/f8d15bd2-8390-4ee1-a0b8-02e575741616 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:41:05.057528 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1778065970", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "networks": [{"uuid": "7da48c38-4590-41ed-b660-5ca513c6073b"}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:05.064638 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:05.108869 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] validate_networks() for [('7da48c38-4590-41ed-b660-5ca513c6073b', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:41:05.499939 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:41:05.500364 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:41:05.500865 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:41:05.501299 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:41:05.501707 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:41:05.510525 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:05.510973 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:05.511764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:05.512218 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:05.529168 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Getting quotas for project 6c3490e18f0c4312a4f7ee37db18344f. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:41:05.533050 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Getting quotas for user 8c1fcfa9effd4d66ad1fef744393a04c and project 6c3490e18f0c4312a4f7ee37db18344f. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:41:05.544213 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:41:05.546445 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:41:05.684270 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-720f1a13-c818-4678-8df7-131418b10b82 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631500 Jul 20 11:41:05.684939 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 298/586] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:41:05.694992 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f0bb5f4-98bb-4ba6-854b-5fd378028a3c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:05.695607 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f0bb5f4-98bb-4ba6-854b-5fd378028a3c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:05.698514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=27 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:05.704848 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=74 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:05.751336 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f0bb5f4-98bb-4ba6-854b-5fd378028a3c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:05.761741 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f0bb5f4-98bb-4ba6-854b-5fd378028a3c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1219 microversion: 2.1 time: 0.070678 Jul 20 11:41:05.762360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 289/587] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:05 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:41:06.780035 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-499e5017-a086-4a93-932e-c73635dd4710 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:06.780645 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-499e5017-a086-4a93-932e-c73635dd4710 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:06.787532 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-499e5017-a086-4a93-932e-c73635dd4710 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:06.788067 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-499e5017-a086-4a93-932e-c73635dd4710 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:06.788812 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-499e5017-a086-4a93-932e-c73635dd4710 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:06.789795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-499e5017-a086-4a93-932e-c73635dd4710 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:06.848740 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-499e5017-a086-4a93-932e-c73635dd4710 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:06.857165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-499e5017-a086-4a93-932e-c73635dd4710 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1223 microversion: 2.1 time: 0.081782 Jul 20 11:41:06.857741 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 299/588] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:06 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:07.874538 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3bfaf060-b0ce-4647-a550-43cecaef4ff2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:07.879011 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3bfaf060-b0ce-4647-a550-43cecaef4ff2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:07.883456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bfaf060-b0ce-4647-a550-43cecaef4ff2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:07.883913 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bfaf060-b0ce-4647-a550-43cecaef4ff2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:07.884702 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bfaf060-b0ce-4647-a550-43cecaef4ff2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:07.885185 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3bfaf060-b0ce-4647-a550-43cecaef4ff2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:07.953963 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3bfaf060-b0ce-4647-a550-43cecaef4ff2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:07.962437 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3bfaf060-b0ce-4647-a550-43cecaef4ff2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1279 microversion: 2.1 time: 0.091944 Jul 20 11:41:07.964964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 290/589] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:07 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:08.979505 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f6c268f2-8a73-4536-b312-ce7362f224fb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:08.980234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f6c268f2-8a73-4536-b312-ce7362f224fb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:08.986836 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6c268f2-8a73-4536-b312-ce7362f224fb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:08.987126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6c268f2-8a73-4536-b312-ce7362f224fb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:08.987893 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6c268f2-8a73-4536-b312-ce7362f224fb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:08.988321 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6c268f2-8a73-4536-b312-ce7362f224fb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:09.121882 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f6c268f2-8a73-4536-b312-ce7362f224fb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:09.129642 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f6c268f2-8a73-4536-b312-ce7362f224fb tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1319 microversion: 2.1 time: 0.153960 Jul 20 11:41:09.139298 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 300/590] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:08 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:09.456334 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-627dc504-7cc1-4152-924f-a8e2eaca4e4e req-c44ef823-ffc6-4708-b3d7-40cb404a3147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90623173-6c8d-4280-97b1-c06ce2c9ca89", "tag": "e765f3a3-8dca-4dc1-a5f1-03d288c33073"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:09.471879 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-627dc504-7cc1-4152-924f-a8e2eaca4e4e req-c44ef823-ffc6-4708-b3d7-40cb404a3147 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:09.472211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-627dc504-7cc1-4152-924f-a8e2eaca4e4e req-c44ef823-ffc6-4708-b3d7-40cb404a3147 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:09.483815 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-627dc504-7cc1-4152-924f-a8e2eaca4e4e req-c44ef823-ffc6-4708-b3d7-40cb404a3147 service nova] Creating event network-changed:e765f3a3-8dca-4dc1-a5f1-03d288c33073 for instance 90623173-6c8d-4280-97b1-c06ce2c9ca89 on hv-cinder-82282 Jul 20 11:41:09.488607 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-627dc504-7cc1-4152-924f-a8e2eaca4e4e req-c44ef823-ffc6-4708-b3d7-40cb404a3147 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036085 Jul 20 11:41:09.489221 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 291/591] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:41:10.148045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fb8ec7e5-2e87-4ea6-b7c9-c397b8b41368 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:10.149239 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fb8ec7e5-2e87-4ea6-b7c9-c397b8b41368 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:10.156015 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb8ec7e5-2e87-4ea6-b7c9-c397b8b41368 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:10.156462 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb8ec7e5-2e87-4ea6-b7c9-c397b8b41368 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:10.157549 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb8ec7e5-2e87-4ea6-b7c9-c397b8b41368 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:10.158123 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb8ec7e5-2e87-4ea6-b7c9-c397b8b41368 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:10.296219 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fb8ec7e5-2e87-4ea6-b7c9-c397b8b41368 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:10.303775 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fb8ec7e5-2e87-4ea6-b7c9-c397b8b41368 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1319 microversion: 2.1 time: 0.159755 Jul 20 11:41:10.304355 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 301/592] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:10 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:11.322701 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-00da80e0-ecea-462f-a27b-e840f11a4af4 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:11.323396 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-00da80e0-ecea-462f-a27b-e840f11a4af4 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:11.329621 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00da80e0-ecea-462f-a27b-e840f11a4af4 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:11.330077 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00da80e0-ecea-462f-a27b-e840f11a4af4 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:11.330841 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00da80e0-ecea-462f-a27b-e840f11a4af4 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:11.331276 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-00da80e0-ecea-462f-a27b-e840f11a4af4 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:11.456773 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-00da80e0-ecea-462f-a27b-e840f11a4af4 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:11.464585 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-00da80e0-ecea-462f-a27b-e840f11a4af4 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1319 microversion: 2.1 time: 0.147099 Jul 20 11:41:11.465187 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 292/593] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:11 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:12.481075 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8e1015f1-169d-49c1-99a3-ae8699a97307 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:12.481682 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8e1015f1-169d-49c1-99a3-ae8699a97307 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:12.488065 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e1015f1-169d-49c1-99a3-ae8699a97307 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:12.488513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e1015f1-169d-49c1-99a3-ae8699a97307 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:12.489299 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e1015f1-169d-49c1-99a3-ae8699a97307 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:12.489734 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e1015f1-169d-49c1-99a3-ae8699a97307 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:12.613952 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8e1015f1-169d-49c1-99a3-ae8699a97307 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:12.621322 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8e1015f1-169d-49c1-99a3-ae8699a97307 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1319 microversion: 2.1 time: 0.144662 Jul 20 11:41:12.621886 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 302/594] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:12 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:13.638567 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d93b4b0-7a0a-45a9-a6a8-e93871aa55b0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:13.639231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2d93b4b0-7a0a-45a9-a6a8-e93871aa55b0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:13.645928 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d93b4b0-7a0a-45a9-a6a8-e93871aa55b0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:13.646368 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d93b4b0-7a0a-45a9-a6a8-e93871aa55b0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:13.647121 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d93b4b0-7a0a-45a9-a6a8-e93871aa55b0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:13.647548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d93b4b0-7a0a-45a9-a6a8-e93871aa55b0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:13.781820 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d93b4b0-7a0a-45a9-a6a8-e93871aa55b0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:13.789119 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2d93b4b0-7a0a-45a9-a6a8-e93871aa55b0 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1319 microversion: 2.1 time: 0.154405 Jul 20 11:41:13.789701 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 293/595] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:13 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:14.806669 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cc4617f7-a2a6-4da6-82b7-59fc6eaf56af tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:14.807195 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cc4617f7-a2a6-4da6-82b7-59fc6eaf56af tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:14.813621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc4617f7-a2a6-4da6-82b7-59fc6eaf56af tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:14.814069 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc4617f7-a2a6-4da6-82b7-59fc6eaf56af tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:14.814825 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc4617f7-a2a6-4da6-82b7-59fc6eaf56af tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:14.815255 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cc4617f7-a2a6-4da6-82b7-59fc6eaf56af tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:14.947082 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cc4617f7-a2a6-4da6-82b7-59fc6eaf56af tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:14.954257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cc4617f7-a2a6-4da6-82b7-59fc6eaf56af tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1319 microversion: 2.1 time: 0.151596 Jul 20 11:41:14.954810 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 303/596] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:14 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:15.971768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-77d02e06-efb4-41d0-869e-f5559b42f2e2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:15.972385 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-77d02e06-efb4-41d0-869e-f5559b42f2e2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:15.975870 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:15.980358 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77d02e06-efb4-41d0-869e-f5559b42f2e2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:15.980819 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77d02e06-efb4-41d0-869e-f5559b42f2e2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:15.981584 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77d02e06-efb4-41d0-869e-f5559b42f2e2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:15.982058 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-77d02e06-efb4-41d0-869e-f5559b42f2e2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:16.117221 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-77d02e06-efb4-41d0-869e-f5559b42f2e2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:16.125270 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-77d02e06-efb4-41d0-869e-f5559b42f2e2 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1319 microversion: 2.1 time: 0.157393 Jul 20 11:41:16.125833 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 294/597] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:15 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:16.173006 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-866ff621-2d32-4be0-b993-d3b03dda1873 req-26aaa7d7-fdfb-4754-88ae-3cae839383fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90623173-6c8d-4280-97b1-c06ce2c9ca89", "name": "network-vif-plugged", "status": "completed", "tag": "e765f3a3-8dca-4dc1-a5f1-03d288c33073"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:16.180151 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:16.180151 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=6 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:16.182766 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-866ff621-2d32-4be0-b993-d3b03dda1873 req-26aaa7d7-fdfb-4754-88ae-3cae839383fd service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:16.183206 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-866ff621-2d32-4be0-b993-d3b03dda1873 req-26aaa7d7-fdfb-4754-88ae-3cae839383fd service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:16.193809 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-866ff621-2d32-4be0-b993-d3b03dda1873 req-26aaa7d7-fdfb-4754-88ae-3cae839383fd service nova] Creating event network-vif-plugged:e765f3a3-8dca-4dc1-a5f1-03d288c33073 for instance 90623173-6c8d-4280-97b1-c06ce2c9ca89 on hv-cinder-82282 Jul 20 11:41:16.198837 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-866ff621-2d32-4be0-b993-d3b03dda1873 req-26aaa7d7-fdfb-4754-88ae-3cae839383fd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029558 Jul 20 11:41:16.199441 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 304/598] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:41:17.142311 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-148f02f4-512c-4823-ae29-773614a54927 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:17.143421 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-148f02f4-512c-4823-ae29-773614a54927 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:17.150795 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-148f02f4-512c-4823-ae29-773614a54927 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:17.151460 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-148f02f4-512c-4823-ae29-773614a54927 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:17.152341 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-148f02f4-512c-4823-ae29-773614a54927 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:17.152768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-148f02f4-512c-4823-ae29-773614a54927 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:17.279917 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-148f02f4-512c-4823-ae29-773614a54927 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:17.287132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-148f02f4-512c-4823-ae29-773614a54927 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1319 microversion: 2.1 time: 0.148884 Jul 20 11:41:17.287721 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 295/599] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:17 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:18.305406 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b592c922-1c28-4244-833e-2115f546d830 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:18.306150 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b592c922-1c28-4244-833e-2115f546d830 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:18.313277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b592c922-1c28-4244-833e-2115f546d830 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:18.313713 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b592c922-1c28-4244-833e-2115f546d830 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:18.314464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b592c922-1c28-4244-833e-2115f546d830 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:18.314892 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b592c922-1c28-4244-833e-2115f546d830 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:18.441303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b592c922-1c28-4244-833e-2115f546d830 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:18.449221 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b592c922-1c28-4244-833e-2115f546d830 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1319 microversion: 2.1 time: 0.148680 Jul 20 11:41:18.449782 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 305/600] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:18 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:19.465917 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fd06f102-8120-41a6-ad06-5a499f729b14 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:19.466517 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fd06f102-8120-41a6-ad06-5a499f729b14 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:19.473023 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd06f102-8120-41a6-ad06-5a499f729b14 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:19.473472 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd06f102-8120-41a6-ad06-5a499f729b14 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:19.474233 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd06f102-8120-41a6-ad06-5a499f729b14 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:19.474668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd06f102-8120-41a6-ad06-5a499f729b14 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:19.609807 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd06f102-8120-41a6-ad06-5a499f729b14 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:19.617387 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fd06f102-8120-41a6-ad06-5a499f729b14 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1319 microversion: 2.1 time: 0.155841 Jul 20 11:41:19.617955 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 296/601] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:19 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:20.634237 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-84a5cfb8-8d10-4f6a-82bc-0f9cefd9438f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:20.634845 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-84a5cfb8-8d10-4f6a-82bc-0f9cefd9438f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:20.641378 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84a5cfb8-8d10-4f6a-82bc-0f9cefd9438f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:20.641822 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84a5cfb8-8d10-4f6a-82bc-0f9cefd9438f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:20.642582 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84a5cfb8-8d10-4f6a-82bc-0f9cefd9438f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:20.643015 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-84a5cfb8-8d10-4f6a-82bc-0f9cefd9438f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:20.767525 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-84a5cfb8-8d10-4f6a-82bc-0f9cefd9438f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:20.775024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-84a5cfb8-8d10-4f6a-82bc-0f9cefd9438f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1508 microversion: 2.1 time: 0.144631 Jul 20 11:41:20.775586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 306/602] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:20 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:20.792587 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f6eaa8b3-4e3c-4994-93be-bb08bfe65b7c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7a9fae0-1210-4bc0-ab87-675c7a33136d", "device": "/dev/sdb"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:20.794303 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f6eaa8b3-4e3c-4994-93be-bb08bfe65b7c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:20.800558 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6eaa8b3-4e3c-4994-93be-bb08bfe65b7c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:20.801027 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6eaa8b3-4e3c-4994-93be-bb08bfe65b7c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:20.801772 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6eaa8b3-4e3c-4994-93be-bb08bfe65b7c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:20.802212 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6eaa8b3-4e3c-4994-93be-bb08bfe65b7c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:21.538622 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f6eaa8b3-4e3c-4994-93be-bb08bfe65b7c tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "POST /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750391 Jul 20 11:41:21.539226 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 297/603] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:41:20 2022] POST /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:41:31.939733 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d4a879ae-f9fb-4c3a-91d3-3a0b3d262c0a tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:31.940683 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d4a879ae-f9fb-4c3a-91d3-3a0b3d262c0a tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:31.943895 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:31.944577 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=48 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:31.949293 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4a879ae-f9fb-4c3a-91d3-3a0b3d262c0a tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:31.949742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4a879ae-f9fb-4c3a-91d3-3a0b3d262c0a tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:31.950559 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4a879ae-f9fb-4c3a-91d3-3a0b3d262c0a tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:31.951000 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d4a879ae-f9fb-4c3a-91d3-3a0b3d262c0a tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:32.139429 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d4a879ae-f9fb-4c3a-91d3-3a0b3d262c0a tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "POST /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/action" status: 202 len: 0 microversion: 2.1 time: 0.203315 Jul 20 11:41:32.140252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 307/604] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:41:31 2022] POST /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:41:32.146716 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=20 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:32.149461 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:32.151656 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cd1f43fd-f687-4aed-9fd8-81f14b547461 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:32.152360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cd1f43fd-f687-4aed-9fd8-81f14b547461 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:32.158484 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd1f43fd-f687-4aed-9fd8-81f14b547461 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:32.158931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd1f43fd-f687-4aed-9fd8-81f14b547461 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:32.159703 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd1f43fd-f687-4aed-9fd8-81f14b547461 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:32.160135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cd1f43fd-f687-4aed-9fd8-81f14b547461 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:32.307805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cd1f43fd-f687-4aed-9fd8-81f14b547461 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:32.317361 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cd1f43fd-f687-4aed-9fd8-81f14b547461 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1752 microversion: 2.1 time: 0.172246 Jul 20 11:41:32.317927 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 298/605] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:32 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:41:33.336360 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-73e62e0e-340d-4a94-9d57-cf1ba5c9b77b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:33.337079 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-73e62e0e-340d-4a94-9d57-cf1ba5c9b77b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:33.343144 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73e62e0e-340d-4a94-9d57-cf1ba5c9b77b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:33.343584 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73e62e0e-340d-4a94-9d57-cf1ba5c9b77b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:33.344336 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73e62e0e-340d-4a94-9d57-cf1ba5c9b77b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:33.344763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-73e62e0e-340d-4a94-9d57-cf1ba5c9b77b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:33.484971 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-73e62e0e-340d-4a94-9d57-cf1ba5c9b77b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:33.494564 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-73e62e0e-340d-4a94-9d57-cf1ba5c9b77b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1752 microversion: 2.1 time: 0.163334 Jul 20 11:41:33.495149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 308/606] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:33 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:34.511701 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f8923368-0486-4d28-a9d2-5eb9ffc18596 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:34.512310 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f8923368-0486-4d28-a9d2-5eb9ffc18596 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:34.520838 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8923368-0486-4d28-a9d2-5eb9ffc18596 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:34.525050 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8923368-0486-4d28-a9d2-5eb9ffc18596 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:34.525050 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8923368-0486-4d28-a9d2-5eb9ffc18596 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:34.525050 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8923368-0486-4d28-a9d2-5eb9ffc18596 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:34.677282 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f8923368-0486-4d28-a9d2-5eb9ffc18596 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:34.685387 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f8923368-0486-4d28-a9d2-5eb9ffc18596 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1752 microversion: 2.1 time: 0.177635 Jul 20 11:41:34.685956 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 299/607] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:34 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:35.153316 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1b5a3c2e-8963-464d-8194-068bd7bbaca4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:35.153839 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1b5a3c2e-8963-464d-8194-068bd7bbaca4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:35.160140 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b5a3c2e-8963-464d-8194-068bd7bbaca4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:35.160582 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b5a3c2e-8963-464d-8194-068bd7bbaca4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:35.161371 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b5a3c2e-8963-464d-8194-068bd7bbaca4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:35.161804 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b5a3c2e-8963-464d-8194-068bd7bbaca4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:35.184720 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1b5a3c2e-8963-464d-8194-068bd7bbaca4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/ips" status: 200 len: 151 microversion: 2.20 time: 0.035298 Jul 20 11:41:35.185305 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 309/608] 10.222.0.43 () {60 vars in 1288 bytes} [Wed Jul 20 11:41:35 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:41:35.703600 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-662a1f46-59b9-4ca4-8297-971c578403e5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:35.704193 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-662a1f46-59b9-4ca4-8297-971c578403e5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:35.711173 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-662a1f46-59b9-4ca4-8297-971c578403e5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:35.715347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-662a1f46-59b9-4ca4-8297-971c578403e5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:35.715347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-662a1f46-59b9-4ca4-8297-971c578403e5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:35.715347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-662a1f46-59b9-4ca4-8297-971c578403e5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:35.877151 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-662a1f46-59b9-4ca4-8297-971c578403e5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:35.886466 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-662a1f46-59b9-4ca4-8297-971c578403e5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1752 microversion: 2.1 time: 0.187272 Jul 20 11:41:35.887047 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 300/609] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:35 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:36.903555 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-285614c0-c56e-4aa7-b6c5-4750316ffff0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:36.904277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-285614c0-c56e-4aa7-b6c5-4750316ffff0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:36.910534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-285614c0-c56e-4aa7-b6c5-4750316ffff0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:36.911005 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-285614c0-c56e-4aa7-b6c5-4750316ffff0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:36.911757 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-285614c0-c56e-4aa7-b6c5-4750316ffff0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:36.912189 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-285614c0-c56e-4aa7-b6c5-4750316ffff0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:37.054044 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-285614c0-c56e-4aa7-b6c5-4750316ffff0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:37.061817 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-285614c0-c56e-4aa7-b6c5-4750316ffff0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.162228 Jul 20 11:41:37.062394 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 310/610] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:36 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:38.079416 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0f3c291b-6e8e-4f00-a792-c7fa2f939b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:38.080046 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0f3c291b-6e8e-4f00-a792-c7fa2f939b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:38.087120 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f3c291b-6e8e-4f00-a792-c7fa2f939b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:38.087570 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f3c291b-6e8e-4f00-a792-c7fa2f939b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:38.088449 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f3c291b-6e8e-4f00-a792-c7fa2f939b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:38.088911 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0f3c291b-6e8e-4f00-a792-c7fa2f939b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:38.230829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0f3c291b-6e8e-4f00-a792-c7fa2f939b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:38.238716 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0f3c291b-6e8e-4f00-a792-c7fa2f939b37 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.163201 Jul 20 11:41:38.239471 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 301/611] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:38 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:38.481070 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dc1e0840-c00c-4e35-af77-ad1e31f16427 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:38.481627 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dc1e0840-c00c-4e35-af77-ad1e31f16427 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:38.487906 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc1e0840-c00c-4e35-af77-ad1e31f16427 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:38.488354 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc1e0840-c00c-4e35-af77-ad1e31f16427 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:38.489142 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc1e0840-c00c-4e35-af77-ad1e31f16427 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:38.489577 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dc1e0840-c00c-4e35-af77-ad1e31f16427 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:38.511491 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-dc1e0840-c00c-4e35-af77-ad1e31f16427 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lazy-loading 'flavor' on Instance uuid ea3abfd3-22be-4728-9006-19ad38c1bd9c {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:41:39.016405 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dc1e0840-c00c-4e35-af77-ad1e31f16427 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "POST /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/action" status: 202 len: 0 microversion: 2.20 time: 0.538902 Jul 20 11:41:39.017104 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 311/612] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jul 20 11:41:38 2022] POST /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:41:39.025827 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-041a66ef-310f-4aa5-b05c-4e8800d8d05e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:39.026436 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-041a66ef-310f-4aa5-b05c-4e8800d8d05e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:39.032371 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-041a66ef-310f-4aa5-b05c-4e8800d8d05e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:39.036124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-041a66ef-310f-4aa5-b05c-4e8800d8d05e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:39.036124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-041a66ef-310f-4aa5-b05c-4e8800d8d05e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:39.036124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-041a66ef-310f-4aa5-b05c-4e8800d8d05e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:39.170207 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-041a66ef-310f-4aa5-b05c-4e8800d8d05e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:39.178668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-041a66ef-310f-4aa5-b05c-4e8800d8d05e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:39.180271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-041a66ef-310f-4aa5-b05c-4e8800d8d05e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:39.181449 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-041a66ef-310f-4aa5-b05c-4e8800d8d05e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.159664 Jul 20 11:41:39.182008 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 302/613] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:39 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:39.256759 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-364e7bb3-ee42-4923-af49-deaa4c90114c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:39.257513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-364e7bb3-ee42-4923-af49-deaa4c90114c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:39.263764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-364e7bb3-ee42-4923-af49-deaa4c90114c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:39.264215 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-364e7bb3-ee42-4923-af49-deaa4c90114c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:39.265015 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-364e7bb3-ee42-4923-af49-deaa4c90114c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:39.265455 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-364e7bb3-ee42-4923-af49-deaa4c90114c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:39.406495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-364e7bb3-ee42-4923-af49-deaa4c90114c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:39.414913 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-364e7bb3-ee42-4923-af49-deaa4c90114c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.162504 Jul 20 11:41:39.415475 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 312/614] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:39 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:40.199411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b01c36f8-a6d3-45c9-8103-7aab338eb96b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:40.200022 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b01c36f8-a6d3-45c9-8103-7aab338eb96b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:40.206634 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b01c36f8-a6d3-45c9-8103-7aab338eb96b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:40.207081 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b01c36f8-a6d3-45c9-8103-7aab338eb96b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:40.207855 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b01c36f8-a6d3-45c9-8103-7aab338eb96b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:40.208287 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b01c36f8-a6d3-45c9-8103-7aab338eb96b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:40.339783 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b01c36f8-a6d3-45c9-8103-7aab338eb96b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:40.348277 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b01c36f8-a6d3-45c9-8103-7aab338eb96b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:40.350630 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b01c36f8-a6d3-45c9-8103-7aab338eb96b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:40.351831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b01c36f8-a6d3-45c9-8103-7aab338eb96b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.155411 Jul 20 11:41:40.351831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 303/615] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:40 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:40.431278 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-287d09a6-dc76-4ed0-b47f-69f9b7f697ac tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:40.431917 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-287d09a6-dc76-4ed0-b47f-69f9b7f697ac tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:40.438464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-287d09a6-dc76-4ed0-b47f-69f9b7f697ac tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:40.438859 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-287d09a6-dc76-4ed0-b47f-69f9b7f697ac tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:40.439611 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-287d09a6-dc76-4ed0-b47f-69f9b7f697ac tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:40.440046 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-287d09a6-dc76-4ed0-b47f-69f9b7f697ac tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:40.578661 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-287d09a6-dc76-4ed0-b47f-69f9b7f697ac tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:40.586965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-287d09a6-dc76-4ed0-b47f-69f9b7f697ac tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.159477 Jul 20 11:41:40.587512 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 313/616] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:40 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:41.369889 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9bc1a866-0626-4c48-8252-6efd1320f355 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:41.370493 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9bc1a866-0626-4c48-8252-6efd1320f355 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:41.376956 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bc1a866-0626-4c48-8252-6efd1320f355 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:41.377403 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bc1a866-0626-4c48-8252-6efd1320f355 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:41.378160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bc1a866-0626-4c48-8252-6efd1320f355 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:41.379156 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9bc1a866-0626-4c48-8252-6efd1320f355 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:41.508920 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9bc1a866-0626-4c48-8252-6efd1320f355 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:41.516680 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9bc1a866-0626-4c48-8252-6efd1320f355 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:41.518222 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9bc1a866-0626-4c48-8252-6efd1320f355 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:41.519637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9bc1a866-0626-4c48-8252-6efd1320f355 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.153646 Jul 20 11:41:41.520190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 304/617] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:41 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:41.603878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0429d4a5-515d-44ca-9c82-e25d19c6e1e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:41.604481 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0429d4a5-515d-44ca-9c82-e25d19c6e1e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:41.611358 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0429d4a5-515d-44ca-9c82-e25d19c6e1e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:41.611969 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0429d4a5-515d-44ca-9c82-e25d19c6e1e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:41.612767 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0429d4a5-515d-44ca-9c82-e25d19c6e1e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:41.613890 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0429d4a5-515d-44ca-9c82-e25d19c6e1e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:41.754995 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0429d4a5-515d-44ca-9c82-e25d19c6e1e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:41.764352 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0429d4a5-515d-44ca-9c82-e25d19c6e1e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.164234 Jul 20 11:41:41.764946 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 314/618] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:41 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:42.537999 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-990b0520-8a47-4196-9dae-676862ccdd6d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:42.538590 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-990b0520-8a47-4196-9dae-676862ccdd6d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:42.545151 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-990b0520-8a47-4196-9dae-676862ccdd6d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:42.545600 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-990b0520-8a47-4196-9dae-676862ccdd6d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:42.546367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-990b0520-8a47-4196-9dae-676862ccdd6d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:42.546804 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-990b0520-8a47-4196-9dae-676862ccdd6d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:42.677537 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-990b0520-8a47-4196-9dae-676862ccdd6d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:42.685553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-990b0520-8a47-4196-9dae-676862ccdd6d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:42.687088 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-990b0520-8a47-4196-9dae-676862ccdd6d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:42.688226 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-990b0520-8a47-4196-9dae-676862ccdd6d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.154146 Jul 20 11:41:42.688799 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 305/619] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:42 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:42.781957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b17efd5e-8ede-4d7c-850b-7a0a70a21494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:42.782595 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b17efd5e-8ede-4d7c-850b-7a0a70a21494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:42.789221 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b17efd5e-8ede-4d7c-850b-7a0a70a21494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:42.789616 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b17efd5e-8ede-4d7c-850b-7a0a70a21494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:42.790380 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b17efd5e-8ede-4d7c-850b-7a0a70a21494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:42.790819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b17efd5e-8ede-4d7c-850b-7a0a70a21494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:42.932540 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b17efd5e-8ede-4d7c-850b-7a0a70a21494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:42.940455 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b17efd5e-8ede-4d7c-850b-7a0a70a21494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.162356 Jul 20 11:41:42.941054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 315/620] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:42 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:43.706317 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e69da74e-ab08-4068-a447-64e1b8ecc718 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:43.706945 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e69da74e-ab08-4068-a447-64e1b8ecc718 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:43.714028 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e69da74e-ab08-4068-a447-64e1b8ecc718 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:43.714481 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e69da74e-ab08-4068-a447-64e1b8ecc718 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:43.715250 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e69da74e-ab08-4068-a447-64e1b8ecc718 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:43.715685 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e69da74e-ab08-4068-a447-64e1b8ecc718 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:43.844079 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e69da74e-ab08-4068-a447-64e1b8ecc718 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:43.851943 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e69da74e-ab08-4068-a447-64e1b8ecc718 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:43.853564 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e69da74e-ab08-4068-a447-64e1b8ecc718 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:43.854716 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e69da74e-ab08-4068-a447-64e1b8ecc718 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.152441 Jul 20 11:41:43.855271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 306/621] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:43 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:43.957952 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c514d5bc-935a-48e0-99db-7dc8f27de679 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:43.958516 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c514d5bc-935a-48e0-99db-7dc8f27de679 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:43.965110 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c514d5bc-935a-48e0-99db-7dc8f27de679 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:43.972597 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c514d5bc-935a-48e0-99db-7dc8f27de679 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:43.972597 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c514d5bc-935a-48e0-99db-7dc8f27de679 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:43.972597 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c514d5bc-935a-48e0-99db-7dc8f27de679 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:44.107958 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c514d5bc-935a-48e0-99db-7dc8f27de679 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:44.115885 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c514d5bc-935a-48e0-99db-7dc8f27de679 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.162749 Jul 20 11:41:44.116453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 316/622] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:43 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:44.873217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56f1b913-0359-4f24-bd05-b1fe0196500f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:44.873856 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56f1b913-0359-4f24-bd05-b1fe0196500f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:44.881126 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56f1b913-0359-4f24-bd05-b1fe0196500f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:44.881573 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56f1b913-0359-4f24-bd05-b1fe0196500f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:44.882337 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56f1b913-0359-4f24-bd05-b1fe0196500f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:44.882780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56f1b913-0359-4f24-bd05-b1fe0196500f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:45.011176 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56f1b913-0359-4f24-bd05-b1fe0196500f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:45.018936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56f1b913-0359-4f24-bd05-b1fe0196500f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:45.020814 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56f1b913-0359-4f24-bd05-b1fe0196500f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:45.022034 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56f1b913-0359-4f24-bd05-b1fe0196500f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.152737 Jul 20 11:41:45.022586 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 307/623] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:44 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:45.133777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4fd95c05-65d9-4052-828f-413d1e43b9e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:45.134689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4fd95c05-65d9-4052-828f-413d1e43b9e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:45.142377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fd95c05-65d9-4052-828f-413d1e43b9e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:45.142818 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fd95c05-65d9-4052-828f-413d1e43b9e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:45.143571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fd95c05-65d9-4052-828f-413d1e43b9e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:45.144001 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4fd95c05-65d9-4052-828f-413d1e43b9e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:45.286666 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4fd95c05-65d9-4052-828f-413d1e43b9e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:45.294581 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4fd95c05-65d9-4052-828f-413d1e43b9e1 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.164955 Jul 20 11:41:45.295128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 317/624] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:45 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:46.040092 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-40d9b8ce-61ab-451a-bd1f-330678b1fc8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:46.040736 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-40d9b8ce-61ab-451a-bd1f-330678b1fc8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:46.047482 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40d9b8ce-61ab-451a-bd1f-330678b1fc8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:46.047928 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40d9b8ce-61ab-451a-bd1f-330678b1fc8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:46.048696 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40d9b8ce-61ab-451a-bd1f-330678b1fc8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:46.049219 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-40d9b8ce-61ab-451a-bd1f-330678b1fc8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:46.186149 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-40d9b8ce-61ab-451a-bd1f-330678b1fc8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:46.189460 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-40d9b8ce-61ab-451a-bd1f-330678b1fc8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:46.190968 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-40d9b8ce-61ab-451a-bd1f-330678b1fc8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:46.192123 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-40d9b8ce-61ab-451a-bd1f-330678b1fc8e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.156559 Jul 20 11:41:46.192677 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 308/625] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:46 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:46.312228 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b48dc968-f388-4c05-b41a-1c4e1c85d3b0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:46.312928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b48dc968-f388-4c05-b41a-1c4e1c85d3b0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:46.319302 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b48dc968-f388-4c05-b41a-1c4e1c85d3b0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:46.319745 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b48dc968-f388-4c05-b41a-1c4e1c85d3b0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:46.320504 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b48dc968-f388-4c05-b41a-1c4e1c85d3b0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:46.320971 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b48dc968-f388-4c05-b41a-1c4e1c85d3b0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:46.465336 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b48dc968-f388-4c05-b41a-1c4e1c85d3b0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:46.473492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b48dc968-f388-4c05-b41a-1c4e1c85d3b0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.165123 Jul 20 11:41:46.474604 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 318/626] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:46 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:47.210436 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8d82f442-9350-4dac-ae43-3d3ce6cccd21 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:47.211039 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8d82f442-9350-4dac-ae43-3d3ce6cccd21 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:47.217600 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d82f442-9350-4dac-ae43-3d3ce6cccd21 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:47.218048 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d82f442-9350-4dac-ae43-3d3ce6cccd21 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:47.218812 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d82f442-9350-4dac-ae43-3d3ce6cccd21 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:47.219240 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d82f442-9350-4dac-ae43-3d3ce6cccd21 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:47.347838 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8d82f442-9350-4dac-ae43-3d3ce6cccd21 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:47.356378 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8d82f442-9350-4dac-ae43-3d3ce6cccd21 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:47.357912 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8d82f442-9350-4dac-ae43-3d3ce6cccd21 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:47.359089 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8d82f442-9350-4dac-ae43-3d3ce6cccd21 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.152819 Jul 20 11:41:47.359639 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 309/627] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:47 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:47.491017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d82095ac-41e9-4bbc-ae9a-0f5d29df8437 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:47.491622 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d82095ac-41e9-4bbc-ae9a-0f5d29df8437 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:47.498006 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d82095ac-41e9-4bbc-ae9a-0f5d29df8437 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:47.498446 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d82095ac-41e9-4bbc-ae9a-0f5d29df8437 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:47.499196 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d82095ac-41e9-4bbc-ae9a-0f5d29df8437 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:47.499625 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d82095ac-41e9-4bbc-ae9a-0f5d29df8437 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:47.626875 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1e3f1a9b-b55e-4701-8f67-cb86848bdb32 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:47.627593 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1e3f1a9b-b55e-4701-8f67-cb86848bdb32 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:47.634681 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e3f1a9b-b55e-4701-8f67-cb86848bdb32 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:47.635194 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e3f1a9b-b55e-4701-8f67-cb86848bdb32 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:47.636132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e3f1a9b-b55e-4701-8f67-cb86848bdb32 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:47.636668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1e3f1a9b-b55e-4701-8f67-cb86848bdb32 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:47.638092 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d82095ac-41e9-4bbc-ae9a-0f5d29df8437 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:47.646511 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d82095ac-41e9-4bbc-ae9a-0f5d29df8437 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.159876 Jul 20 11:41:47.647089 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 319/628] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:47 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:47.785175 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-1e3f1a9b-b55e-4701-8f67-cb86848bdb32 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lazy-loading 'services' on Instance uuid 90623173-6c8d-4280-97b1-c06ce2c9ca89 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:41:47.997408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1e3f1a9b-b55e-4701-8f67-cb86848bdb32 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "DELETE /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89/os-volume_attachments/a7a9fae0-1210-4bc0-ab87-675c7a33136d" status: 202 len: 0 microversion: 2.1 time: 0.374583 Jul 20 11:41:47.998029 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 310/629] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 11:41:47 2022] DELETE /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89/os-volume_attachments/a7a9fae0-1210-4bc0-ab87-675c7a33136d => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:41:48.377694 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fe350fb9-7205-4ccf-aa04-3f26dcaea808 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:48.378216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fe350fb9-7205-4ccf-aa04-3f26dcaea808 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:48.384697 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe350fb9-7205-4ccf-aa04-3f26dcaea808 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:48.385178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe350fb9-7205-4ccf-aa04-3f26dcaea808 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:48.385940 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe350fb9-7205-4ccf-aa04-3f26dcaea808 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:48.386378 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fe350fb9-7205-4ccf-aa04-3f26dcaea808 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:48.515492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fe350fb9-7205-4ccf-aa04-3f26dcaea808 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:48.518963 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:48.523952 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fe350fb9-7205-4ccf-aa04-3f26dcaea808 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:48.525481 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fe350fb9-7205-4ccf-aa04-3f26dcaea808 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:48.526662 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fe350fb9-7205-4ccf-aa04-3f26dcaea808 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.153012 Jul 20 11:41:48.527216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 320/630] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:48 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:48.664308 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b7c701c8-7782-42c3-96c7-1c9bf248f8d7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:48.665007 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b7c701c8-7782-42c3-96c7-1c9bf248f8d7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:48.671648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c701c8-7782-42c3-96c7-1c9bf248f8d7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:48.672083 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c701c8-7782-42c3-96c7-1c9bf248f8d7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:48.672853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c701c8-7782-42c3-96c7-1c9bf248f8d7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:48.673281 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c701c8-7782-42c3-96c7-1c9bf248f8d7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:48.818538 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7c701c8-7782-42c3-96c7-1c9bf248f8d7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:48.826804 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b7c701c8-7782-42c3-96c7-1c9bf248f8d7 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.167116 Jul 20 11:41:48.827401 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 311/631] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:48 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:49.546215 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fcbdfd29-e456-439e-ab4d-24b3e4b4ddb7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:49.546828 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fcbdfd29-e456-439e-ab4d-24b3e4b4ddb7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:49.553678 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcbdfd29-e456-439e-ab4d-24b3e4b4ddb7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:49.554128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcbdfd29-e456-439e-ab4d-24b3e4b4ddb7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:49.554929 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcbdfd29-e456-439e-ab4d-24b3e4b4ddb7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:49.555363 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fcbdfd29-e456-439e-ab4d-24b3e4b4ddb7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:49.686677 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fcbdfd29-e456-439e-ab4d-24b3e4b4ddb7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:49.695074 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fcbdfd29-e456-439e-ab4d-24b3e4b4ddb7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:49.696703 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fcbdfd29-e456-439e-ab4d-24b3e4b4ddb7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:49.697883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fcbdfd29-e456-439e-ab4d-24b3e4b4ddb7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.156353 Jul 20 11:41:49.698443 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 321/632] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:49 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:49.843318 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7a6e6a81-dfbf-4812-b676-633d7ca35bf5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:49.843939 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7a6e6a81-dfbf-4812-b676-633d7ca35bf5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:49.850624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a6e6a81-dfbf-4812-b676-633d7ca35bf5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:49.851063 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a6e6a81-dfbf-4812-b676-633d7ca35bf5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:49.851974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a6e6a81-dfbf-4812-b676-633d7ca35bf5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:49.852289 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7a6e6a81-dfbf-4812-b676-633d7ca35bf5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:49.996165 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7a6e6a81-dfbf-4812-b676-633d7ca35bf5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:50.004163 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7a6e6a81-dfbf-4812-b676-633d7ca35bf5 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.164709 Jul 20 11:41:50.005363 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 312/633] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:49 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:50.166762 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7a0054f3-0ee6-42d9-b7e3-458cf54edab1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:50.167253 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7a0054f3-0ee6-42d9-b7e3-458cf54edab1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:50.173819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a0054f3-0ee6-42d9-b7e3-458cf54edab1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:50.174273 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a0054f3-0ee6-42d9-b7e3-458cf54edab1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:50.175054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a0054f3-0ee6-42d9-b7e3-458cf54edab1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:50.175490 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7a0054f3-0ee6-42d9-b7e3-458cf54edab1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:50.200604 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7a0054f3-0ee6-42d9-b7e3-458cf54edab1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:41:50.438266 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7a0054f3-0ee6-42d9-b7e3-458cf54edab1 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "DELETE /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 204 len: 0 microversion: 2.1 time: 0.274973 Jul 20 11:41:50.438862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 322/634] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:41:50 2022] DELETE /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:41:50.446934 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-93916cf9-ed76-4a58-8b81-671b2dc5a961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:50.447556 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-93916cf9-ed76-4a58-8b81-671b2dc5a961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:50.455407 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93916cf9-ed76-4a58-8b81-671b2dc5a961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:50.455407 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93916cf9-ed76-4a58-8b81-671b2dc5a961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:50.455407 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93916cf9-ed76-4a58-8b81-671b2dc5a961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:50.455407 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-93916cf9-ed76-4a58-8b81-671b2dc5a961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:50.584631 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-93916cf9-ed76-4a58-8b81-671b2dc5a961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:50.588178 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:50.592555 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-93916cf9-ed76-4a58-8b81-671b2dc5a961 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1514 microversion: 2.1 time: 0.149407 Jul 20 11:41:50.593154 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 313/635] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:50 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:50.717227 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3dc7ad51-9a9d-4b58-bdb1-73a3514fb9ef tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:50.717836 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3dc7ad51-9a9d-4b58-bdb1-73a3514fb9ef tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:50.724763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3dc7ad51-9a9d-4b58-bdb1-73a3514fb9ef tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:50.725226 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3dc7ad51-9a9d-4b58-bdb1-73a3514fb9ef tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:50.725979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3dc7ad51-9a9d-4b58-bdb1-73a3514fb9ef tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:50.726408 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3dc7ad51-9a9d-4b58-bdb1-73a3514fb9ef tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:50.852056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3dc7ad51-9a9d-4b58-bdb1-73a3514fb9ef tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:50.859785 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3dc7ad51-9a9d-4b58-bdb1-73a3514fb9ef tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:50.861310 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3dc7ad51-9a9d-4b58-bdb1-73a3514fb9ef tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:50.862441 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3dc7ad51-9a9d-4b58-bdb1-73a3514fb9ef tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.149555 Jul 20 11:41:50.862993 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 323/636] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:50 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:51.022771 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b19c445f-1dab-47dc-9749-400d4784013b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:51.023377 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b19c445f-1dab-47dc-9749-400d4784013b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:51.030107 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b19c445f-1dab-47dc-9749-400d4784013b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:51.030545 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b19c445f-1dab-47dc-9749-400d4784013b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:51.031300 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b19c445f-1dab-47dc-9749-400d4784013b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:51.031728 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b19c445f-1dab-47dc-9749-400d4784013b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:51.169562 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b19c445f-1dab-47dc-9749-400d4784013b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:51.177279 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b19c445f-1dab-47dc-9749-400d4784013b tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.159455 Jul 20 11:41:51.177835 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 314/637] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:51 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:51.610334 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6f7a2ead-78b1-4aee-9a31-fa07654a3b2f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:51.610950 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6f7a2ead-78b1-4aee-9a31-fa07654a3b2f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:51.617569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f7a2ead-78b1-4aee-9a31-fa07654a3b2f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:51.618017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f7a2ead-78b1-4aee-9a31-fa07654a3b2f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:51.618781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f7a2ead-78b1-4aee-9a31-fa07654a3b2f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:51.619223 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6f7a2ead-78b1-4aee-9a31-fa07654a3b2f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:51.747548 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6f7a2ead-78b1-4aee-9a31-fa07654a3b2f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:51.754926 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6f7a2ead-78b1-4aee-9a31-fa07654a3b2f tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1514 microversion: 2.1 time: 0.148504 Jul 20 11:41:51.756067 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 324/638] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:51 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:51.880543 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e7e122b4-e18e-4318-a98d-f4f4bc4f2f0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:51.881169 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e7e122b4-e18e-4318-a98d-f4f4bc4f2f0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:51.887081 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7e122b4-e18e-4318-a98d-f4f4bc4f2f0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:51.887517 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7e122b4-e18e-4318-a98d-f4f4bc4f2f0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:51.888271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7e122b4-e18e-4318-a98d-f4f4bc4f2f0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:51.888696 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7e122b4-e18e-4318-a98d-f4f4bc4f2f0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:52.015077 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e7e122b4-e18e-4318-a98d-f4f4bc4f2f0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:52.023426 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e7e122b4-e18e-4318-a98d-f4f4bc4f2f0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:52.024951 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e7e122b4-e18e-4318-a98d-f4f4bc4f2f0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:52.026096 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e7e122b4-e18e-4318-a98d-f4f4bc4f2f0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.149415 Jul 20 11:41:52.026650 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 315/639] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:51 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:41:52.194685 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-79fcceb3-c901-41de-84f5-9b5025ffbd32 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:52.195324 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-79fcceb3-c901-41de-84f5-9b5025ffbd32 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:52.201333 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79fcceb3-c901-41de-84f5-9b5025ffbd32 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:52.201779 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79fcceb3-c901-41de-84f5-9b5025ffbd32 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:52.202537 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79fcceb3-c901-41de-84f5-9b5025ffbd32 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:52.202972 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-79fcceb3-c901-41de-84f5-9b5025ffbd32 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:52.351539 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-79fcceb3-c901-41de-84f5-9b5025ffbd32 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:52.359799 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-79fcceb3-c901-41de-84f5-9b5025ffbd32 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.169030 Jul 20 11:41:52.365285 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 325/640] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:52 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:52.773886 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a1d3b496-05cd-490b-a881-df1263930156 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:52.774490 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a1d3b496-05cd-490b-a881-df1263930156 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:52.781048 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1d3b496-05cd-490b-a881-df1263930156 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:52.781489 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1d3b496-05cd-490b-a881-df1263930156 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:52.782240 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1d3b496-05cd-490b-a881-df1263930156 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:52.782663 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a1d3b496-05cd-490b-a881-df1263930156 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:52.913473 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a1d3b496-05cd-490b-a881-df1263930156 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:52.920983 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a1d3b496-05cd-490b-a881-df1263930156 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1514 microversion: 2.1 time: 0.151701 Jul 20 11:41:52.921547 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 316/641] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:52 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:53.081181 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9f0e2b47-b830-44a4-81c8-4c6359ff5d50 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:53.081181 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9f0e2b47-b830-44a4-81c8-4c6359ff5d50 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:53.081181 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f0e2b47-b830-44a4-81c8-4c6359ff5d50 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.081181 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f0e2b47-b830-44a4-81c8-4c6359ff5d50 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.082091 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f0e2b47-b830-44a4-81c8-4c6359ff5d50 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.082091 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f0e2b47-b830-44a4-81c8-4c6359ff5d50 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.186557 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f0e2b47-b830-44a4-81c8-4c6359ff5d50 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:53.194605 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f0e2b47-b830-44a4-81c8-4c6359ff5d50 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:53.196114 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f0e2b47-b830-44a4-81c8-4c6359ff5d50 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:53.197303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9f0e2b47-b830-44a4-81c8-4c6359ff5d50 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.156220 Jul 20 11:41:53.197861 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 326/642] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:53 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:41:53.377115 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c5251339-f966-45f8-bdd8-9ab1c0a51751 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:53.377655 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c5251339-f966-45f8-bdd8-9ab1c0a51751 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:53.383998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5251339-f966-45f8-bdd8-9ab1c0a51751 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.384445 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5251339-f966-45f8-bdd8-9ab1c0a51751 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.385232 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5251339-f966-45f8-bdd8-9ab1c0a51751 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.385664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5251339-f966-45f8-bdd8-9ab1c0a51751 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.527820 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c5251339-f966-45f8-bdd8-9ab1c0a51751 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:53.539439 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c5251339-f966-45f8-bdd8-9ab1c0a51751 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1757 microversion: 2.1 time: 0.166089 Jul 20 11:41:53.544824 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 317/643] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:53 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:53.599480 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-d6def7b3-1e27-44d2-919e-3427c6a456cf req-cb3cdad5-0b2f-469e-8bed-0580c9d33ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90623173-6c8d-4280-97b1-c06ce2c9ca89", "name": "network-vif-deleted", "tag": "e765f3a3-8dca-4dc1-a5f1-03d288c33073"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:53.608441 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d6def7b3-1e27-44d2-919e-3427c6a456cf req-cb3cdad5-0b2f-469e-8bed-0580c9d33ced service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.608991 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d6def7b3-1e27-44d2-919e-3427c6a456cf req-cb3cdad5-0b2f-469e-8bed-0580c9d33ced service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.621847 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-d6def7b3-1e27-44d2-919e-3427c6a456cf req-cb3cdad5-0b2f-469e-8bed-0580c9d33ced service nova] Creating event network-vif-deleted:e765f3a3-8dca-4dc1-a5f1-03d288c33073 for instance 90623173-6c8d-4280-97b1-c06ce2c9ca89 on hv-cinder-82282 Jul 20 11:41:53.627510 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-d6def7b3-1e27-44d2-919e-3427c6a456cf req-cb3cdad5-0b2f-469e-8bed-0580c9d33ced service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031867 Jul 20 11:41:53.628210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 327/644] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:41:53.937861 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-94076029-75b4-4e8f-931b-36123596b9b8 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:53.938428 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-94076029-75b4-4e8f-931b-36123596b9b8 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:53.945487 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94076029-75b4-4e8f-931b-36123596b9b8 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.945932 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94076029-75b4-4e8f-931b-36123596b9b8 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.946696 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94076029-75b4-4e8f-931b-36123596b9b8 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.947124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94076029-75b4-4e8f-931b-36123596b9b8 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:54.007897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-94076029-75b4-4e8f-931b-36123596b9b8 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:54.015196 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-94076029-75b4-4e8f-931b-36123596b9b8 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1472 microversion: 2.1 time: 0.081283 Jul 20 11:41:54.015789 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 318/645] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:53 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1472 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:54.217119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-00bdc624-785f-4950-9aeb-56c2ae7c6301 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:54.217729 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-00bdc624-785f-4950-9aeb-56c2ae7c6301 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:54.223878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00bdc624-785f-4950-9aeb-56c2ae7c6301 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:54.226805 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00bdc624-785f-4950-9aeb-56c2ae7c6301 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:54.226805 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00bdc624-785f-4950-9aeb-56c2ae7c6301 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:54.226805 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-00bdc624-785f-4950-9aeb-56c2ae7c6301 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:54.361935 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-00bdc624-785f-4950-9aeb-56c2ae7c6301 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:54.372003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-00bdc624-785f-4950-9aeb-56c2ae7c6301 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:54.372353 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-00bdc624-785f-4950-9aeb-56c2ae7c6301 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:54.374135 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-00bdc624-785f-4950-9aeb-56c2ae7c6301 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.162259 Jul 20 11:41:54.374702 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 328/646] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:54 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:54.557737 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4e7727ae-0ff6-4808-b523-d33d4b4eb3c0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:54.558683 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4e7727ae-0ff6-4808-b523-d33d4b4eb3c0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:54.564931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e7727ae-0ff6-4808-b523-d33d4b4eb3c0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:54.565370 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e7727ae-0ff6-4808-b523-d33d4b4eb3c0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:54.566124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e7727ae-0ff6-4808-b523-d33d4b4eb3c0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:54.566550 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4e7727ae-0ff6-4808-b523-d33d4b4eb3c0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:54.712961 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4e7727ae-0ff6-4808-b523-d33d4b4eb3c0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:54.720861 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4e7727ae-0ff6-4808-b523-d33d4b4eb3c0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1760 microversion: 2.1 time: 0.167887 Jul 20 11:41:54.721435 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 319/647] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:54 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1760 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:55.032494 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f7e5967d-4694-4d44-a866-795efed893b5 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:55.033129 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f7e5967d-4694-4d44-a866-795efed893b5 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:55.039653 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7e5967d-4694-4d44-a866-795efed893b5 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:55.040101 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7e5967d-4694-4d44-a866-795efed893b5 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:55.040904 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7e5967d-4694-4d44-a866-795efed893b5 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:55.041343 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7e5967d-4694-4d44-a866-795efed893b5 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:55.072252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7e5967d-4694-4d44-a866-795efed893b5 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:55.072689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f7e5967d-4694-4d44-a866-795efed893b5 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:55.077660 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-f7e5967d-4694-4d44-a866-795efed893b5 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lazy-loading 'fault' on Instance uuid 90623173-6c8d-4280-97b1-c06ce2c9ca89 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:41:55.113201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f7e5967d-4694-4d44-a866-795efed893b5 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1fcfa9effd4d66ad1fef744393a04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3490e18f0c4312a4f7ee37db18344f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:55.121163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f7e5967d-4694-4d44-a866-795efed893b5 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 200 len: 1309 microversion: 2.1 time: 0.092415 Jul 20 11:41:55.121658 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 329/648] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:55 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:55.391760 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d1920d0-d888-4ba2-84a4-2d11ae215603 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:55.392276 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2d1920d0-d888-4ba2-84a4-2d11ae215603 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:55.399463 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d1920d0-d888-4ba2-84a4-2d11ae215603 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:55.399968 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d1920d0-d888-4ba2-84a4-2d11ae215603 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:55.400657 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d1920d0-d888-4ba2-84a4-2d11ae215603 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:55.401110 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d1920d0-d888-4ba2-84a4-2d11ae215603 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:55.531304 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d1920d0-d888-4ba2-84a4-2d11ae215603 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:55.539893 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d1920d0-d888-4ba2-84a4-2d11ae215603 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:55.541418 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d1920d0-d888-4ba2-84a4-2d11ae215603 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:55.542557 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2d1920d0-d888-4ba2-84a4-2d11ae215603 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.154760 Jul 20 11:41:55.543106 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 320/649] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:55 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:56.138560 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f6709c42-3ae4-47a7-b6e7-b17903ed6b53 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:56.139201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f6709c42-3ae4-47a7-b6e7-b17903ed6b53 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] [instance: 90623173-6c8d-4280-97b1-c06ce2c9ca89] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:56.145860 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6709c42-3ae4-47a7-b6e7-b17903ed6b53 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:56.146302 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6709c42-3ae4-47a7-b6e7-b17903ed6b53 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:56.147059 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6709c42-3ae4-47a7-b6e7-b17903ed6b53 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:56.147488 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f6709c42-3ae4-47a7-b6e7-b17903ed6b53 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:56.161523 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-f6709c42-3ae4-47a7-b6e7-b17903ed6b53 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] HTTP exception thrown: Instance 90623173-6c8d-4280-97b1-c06ce2c9ca89 could not be found. Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f6709c42-3ae4-47a7-b6e7-b17903ed6b53 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Request method failure captured: Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 HTTP/1.1 Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-k9-sCuOfWzwE4c8VvSzhk9klsEGcoOykR2qNnH_Y9jI_PxG75_GcI-HD80DDXEAuyLRSCa9MWSpR1uYg8wcHzJ2fAQhq8u_hA2brQo1etxJCqON80dsZ-l44ATFoZ5GuD9RwhR83cN6p7yGPs6j48b1PB2eTsWm7f0kwNj9maBE0s Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: 6c3490e18f0c4312a4f7ee37db18344f Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1875259575 Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:41:56.163125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:41:56.164742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c3490e18f0c4312a4f7ee37db18344f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6c3490e18f0c4312a4f7ee37db18344f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6c3490e18f0c4312a4f7ee37db18344f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6c3490e18f0c4312a4f7ee37db18344f"}]}] Jul 20 11:41:56.164742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotTestJSON-1875259575 Jul 20 11:41:56.164742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 6c3490e18f0c4312a4f7ee37db18344f Jul 20 11:41:56.164742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1875259575 Jul 20 11:41:56.164742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotTestJSON-1875259575-project Jul 20 11:41:56.164742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:41:56.164742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:41:56.164742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 8c1fcfa9effd4d66ad1fef744393a04c Jul 20 11:41:56.164742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotTestJSON-1875259575-project Jul 20 11:41:56.164742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:41:56.164742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance 90623173-6c8d-4280-97b1-c06ce2c9ca89 could not be found. Jul 20 11:41:56.164742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': '90623173-6c8d-4280-97b1-c06ce2c9ca89'} Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90623173-6c8d-4280-97b1-c06ce2c9ca89 could not be found. Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:41:56.165629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90623173-6c8d-4280-97b1-c06ce2c9ca89 could not be found. Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90623173-6c8d-4280-97b1-c06ce2c9ca89 could not be found. Jul 20 11:41:56.167090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:41:56.168303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f6709c42-3ae4-47a7-b6e7-b17903ed6b53 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] Returning 404 to user: Instance 90623173-6c8d-4280-97b1-c06ce2c9ca89 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:41:56.168303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f6709c42-3ae4-47a7-b6e7-b17903ed6b53 tempest-VolumesSnapshotTestJSON-1875259575 tempest-VolumesSnapshotTestJSON-1875259575-project] 10.222.0.43 "GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89" status: 404 len: 111 microversion: 2.1 time: 0.029827 Jul 20 11:41:56.168303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 330/650] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:56 2022] GET /compute/v2.1/servers/90623173-6c8d-4280-97b1-c06ce2c9ca89 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:41:56.560754 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3ef5ea3e-e6cb-4d27-838e-801e04a184a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:56.561480 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3ef5ea3e-e6cb-4d27-838e-801e04a184a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:56.568369 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ef5ea3e-e6cb-4d27-838e-801e04a184a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:56.568858 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ef5ea3e-e6cb-4d27-838e-801e04a184a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:56.572804 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ef5ea3e-e6cb-4d27-838e-801e04a184a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:56.572804 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3ef5ea3e-e6cb-4d27-838e-801e04a184a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:56.709411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ef5ea3e-e6cb-4d27-838e-801e04a184a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:56.715321 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ef5ea3e-e6cb-4d27-838e-801e04a184a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:56.716825 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3ef5ea3e-e6cb-4d27-838e-801e04a184a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:56.717962 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3ef5ea3e-e6cb-4d27-838e-801e04a184a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.161178 Jul 20 11:41:56.718527 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 321/651] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:56 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:57.736732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-68ba0c24-511b-462f-ac28-381f55555cc4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:57.737526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-68ba0c24-511b-462f-ac28-381f55555cc4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:57.744502 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68ba0c24-511b-462f-ac28-381f55555cc4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:57.744980 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68ba0c24-511b-462f-ac28-381f55555cc4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:57.745774 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68ba0c24-511b-462f-ac28-381f55555cc4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:57.746201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-68ba0c24-511b-462f-ac28-381f55555cc4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:57.875774 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-68ba0c24-511b-462f-ac28-381f55555cc4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:57.883756 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-68ba0c24-511b-462f-ac28-381f55555cc4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:57.885297 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-68ba0c24-511b-462f-ac28-381f55555cc4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:57.886448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-68ba0c24-511b-462f-ac28-381f55555cc4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.153751 Jul 20 11:41:57.887002 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 331/652] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:57 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:41:58.905608 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c5a96e1d-a05b-4c93-b8c1-457fecbf9ab5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:58.906213 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c5a96e1d-a05b-4c93-b8c1-457fecbf9ab5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:58.912776 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5a96e1d-a05b-4c93-b8c1-457fecbf9ab5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:58.916892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5a96e1d-a05b-4c93-b8c1-457fecbf9ab5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:58.916892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5a96e1d-a05b-4c93-b8c1-457fecbf9ab5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:58.916892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5a96e1d-a05b-4c93-b8c1-457fecbf9ab5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:59.043556 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c5a96e1d-a05b-4c93-b8c1-457fecbf9ab5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:59.051491 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c5a96e1d-a05b-4c93-b8c1-457fecbf9ab5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:59.053034 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c5a96e1d-a05b-4c93-b8c1-457fecbf9ab5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:59.054184 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c5a96e1d-a05b-4c93-b8c1-457fecbf9ab5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.152614 Jul 20 11:41:59.054743 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 322/653] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:41:58 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:00.073410 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-93cc05c9-8ed6-47b1-8f04-8d779d86095c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:00.074009 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-93cc05c9-8ed6-47b1-8f04-8d779d86095c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:00.080412 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93cc05c9-8ed6-47b1-8f04-8d779d86095c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:00.080881 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93cc05c9-8ed6-47b1-8f04-8d779d86095c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:00.081635 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93cc05c9-8ed6-47b1-8f04-8d779d86095c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:00.082061 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93cc05c9-8ed6-47b1-8f04-8d779d86095c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:00.211506 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-93cc05c9-8ed6-47b1-8f04-8d779d86095c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:00.220340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-93cc05c9-8ed6-47b1-8f04-8d779d86095c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:00.221860 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-93cc05c9-8ed6-47b1-8f04-8d779d86095c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:00.223016 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-93cc05c9-8ed6-47b1-8f04-8d779d86095c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1745 microversion: 2.20 time: 0.154104 Jul 20 11:42:00.223880 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 332/654] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:00 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:00.271163 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f7782fc3-05d8-4607-8700-8a9a07a082a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce74fc08-4dfb-45ff-b938-25c7c8148369"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:00.272378 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f7782fc3-05d8-4607-8700-8a9a07a082a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:00.278938 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7782fc3-05d8-4607-8700-8a9a07a082a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:00.279383 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7782fc3-05d8-4607-8700-8a9a07a082a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:00.280139 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7782fc3-05d8-4607-8700-8a9a07a082a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:00.280568 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f7782fc3-05d8-4607-8700-8a9a07a082a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:01.241114 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e35482d7-f6a0-46de-bab8-4c5389312d5d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:01.241717 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e35482d7-f6a0-46de-bab8-4c5389312d5d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:01.248537 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e35482d7-f6a0-46de-bab8-4c5389312d5d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:01.249009 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e35482d7-f6a0-46de-bab8-4c5389312d5d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:01.249903 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e35482d7-f6a0-46de-bab8-4c5389312d5d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:01.250266 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e35482d7-f6a0-46de-bab8-4c5389312d5d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:01.380264 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e35482d7-f6a0-46de-bab8-4c5389312d5d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:01.389377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e35482d7-f6a0-46de-bab8-4c5389312d5d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:01.390866 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e35482d7-f6a0-46de-bab8-4c5389312d5d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:01.392024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e35482d7-f6a0-46de-bab8-4c5389312d5d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1745 microversion: 2.20 time: 0.154702 Jul 20 11:42:01.392565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 333/655] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:01 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:42:02.410233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f078a46-6b7e-42c8-b96c-8f4fba0cebc6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:02.410884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0f078a46-6b7e-42c8-b96c-8f4fba0cebc6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:02.413237 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:02.418694 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f078a46-6b7e-42c8-b96c-8f4fba0cebc6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:02.421792 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f078a46-6b7e-42c8-b96c-8f4fba0cebc6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:02.423709 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f078a46-6b7e-42c8-b96c-8f4fba0cebc6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:02.424155 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f078a46-6b7e-42c8-b96c-8f4fba0cebc6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:02.551752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f078a46-6b7e-42c8-b96c-8f4fba0cebc6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:02.561903 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f078a46-6b7e-42c8-b96c-8f4fba0cebc6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:02.563395 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0f078a46-6b7e-42c8-b96c-8f4fba0cebc6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:02.564564 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0f078a46-6b7e-42c8-b96c-8f4fba0cebc6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1745 microversion: 2.20 time: 0.158226 Jul 20 11:42:02.565157 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 334/656] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:02 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:42:03.582862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bd158bd9-eacc-4f46-be2c-90f90c53c366 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:03.587087 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bd158bd9-eacc-4f46-be2c-90f90c53c366 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:03.589892 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd158bd9-eacc-4f46-be2c-90f90c53c366 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:03.590341 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd158bd9-eacc-4f46-be2c-90f90c53c366 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:03.591106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd158bd9-eacc-4f46-be2c-90f90c53c366 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:03.591539 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bd158bd9-eacc-4f46-be2c-90f90c53c366 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:03.731690 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bd158bd9-eacc-4f46-be2c-90f90c53c366 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:03.739866 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bd158bd9-eacc-4f46-be2c-90f90c53c366 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:03.741411 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bd158bd9-eacc-4f46-be2c-90f90c53c366 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:03.742574 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bd158bd9-eacc-4f46-be2c-90f90c53c366 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1745 microversion: 2.20 time: 0.163665 Jul 20 11:42:03.743140 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 335/657] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:03 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:42:04.557329 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f7782fc3-05d8-4607-8700-8a9a07a082a8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "POST /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.439819 Jul 20 11:42:04.558084 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 323/658] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:42:00 2022] POST /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-volume_attachments => generated 194 bytes in 4442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:42:04.761539 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7f0dd3bc-22b2-4ef4-b616-6294bf9875fa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:04.762140 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7f0dd3bc-22b2-4ef4-b616-6294bf9875fa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:04.768610 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f0dd3bc-22b2-4ef4-b616-6294bf9875fa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:04.769097 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f0dd3bc-22b2-4ef4-b616-6294bf9875fa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:04.770102 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f0dd3bc-22b2-4ef4-b616-6294bf9875fa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:04.770540 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7f0dd3bc-22b2-4ef4-b616-6294bf9875fa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:04.908761 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f0dd3bc-22b2-4ef4-b616-6294bf9875fa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:04.918463 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:04.923445 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f0dd3bc-22b2-4ef4-b616-6294bf9875fa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:04.924980 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7f0dd3bc-22b2-4ef4-b616-6294bf9875fa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:04.934955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7f0dd3bc-22b2-4ef4-b616-6294bf9875fa tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1745 microversion: 2.20 time: 0.168952 Jul 20 11:42:04.934955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 336/659] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:04 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:05.945479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-585efc8b-b5e8-431f-ba63-4a1438b8c972 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:05.946175 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-585efc8b-b5e8-431f-ba63-4a1438b8c972 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:05.949629 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=53 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:05.953344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-585efc8b-b5e8-431f-ba63-4a1438b8c972 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:05.953794 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-585efc8b-b5e8-431f-ba63-4a1438b8c972 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:05.954570 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-585efc8b-b5e8-431f-ba63-4a1438b8c972 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:05.955003 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-585efc8b-b5e8-431f-ba63-4a1438b8c972 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:06.085793 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-585efc8b-b5e8-431f-ba63-4a1438b8c972 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:06.095054 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-585efc8b-b5e8-431f-ba63-4a1438b8c972 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:06.096437 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-585efc8b-b5e8-431f-ba63-4a1438b8c972 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:06.097621 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-585efc8b-b5e8-431f-ba63-4a1438b8c972 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1745 microversion: 2.20 time: 0.156512 Jul 20 11:42:06.098176 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 324/660] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:05 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:06.361345 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-9c93fef4-6f63-4993-aa46-9fff6853d9a8 req-5dce76aa-5a07-4746-90d1-bf503360e6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3abfd3-22be-4728-9006-19ad38c1bd9c", "name": "network-vif-plugged", "status": "completed", "tag": "e605e30c-d865-4978-9798-9dc53408552e"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:06.370565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-9c93fef4-6f63-4993-aa46-9fff6853d9a8 req-5dce76aa-5a07-4746-90d1-bf503360e6f4 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:06.371001 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-9c93fef4-6f63-4993-aa46-9fff6853d9a8 req-5dce76aa-5a07-4746-90d1-bf503360e6f4 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:06.381685 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-9c93fef4-6f63-4993-aa46-9fff6853d9a8 req-5dce76aa-5a07-4746-90d1-bf503360e6f4 service nova] Creating event network-vif-plugged:e605e30c-d865-4978-9798-9dc53408552e for instance ea3abfd3-22be-4728-9006-19ad38c1bd9c on hv-cinder-82282 Jul 20 11:42:06.387157 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-9c93fef4-6f63-4993-aa46-9fff6853d9a8 req-5dce76aa-5a07-4746-90d1-bf503360e6f4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145688 Jul 20 11:42:06.387715 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 337/661] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:42:07.115268 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0b8b283c-33dd-48f2-bc69-817abe95ed70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:07.115954 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0b8b283c-33dd-48f2-bc69-817abe95ed70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:07.122437 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b8b283c-33dd-48f2-bc69-817abe95ed70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:07.123084 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b8b283c-33dd-48f2-bc69-817abe95ed70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:07.123859 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b8b283c-33dd-48f2-bc69-817abe95ed70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:07.124288 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b8b283c-33dd-48f2-bc69-817abe95ed70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:07.256248 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0b8b283c-33dd-48f2-bc69-817abe95ed70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:07.264530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0b8b283c-33dd-48f2-bc69-817abe95ed70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:07.266746 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0b8b283c-33dd-48f2-bc69-817abe95ed70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:07.267910 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0b8b283c-33dd-48f2-bc69-817abe95ed70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1745 microversion: 2.20 time: 0.156473 Jul 20 11:42:07.268652 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 325/662] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:07 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:08.288083 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-791a3a0b-7220-4216-b5a3-c0781c98565a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:08.288723 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-791a3a0b-7220-4216-b5a3-c0781c98565a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:08.295985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-791a3a0b-7220-4216-b5a3-c0781c98565a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:08.296433 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-791a3a0b-7220-4216-b5a3-c0781c98565a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:08.297222 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-791a3a0b-7220-4216-b5a3-c0781c98565a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:08.297659 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-791a3a0b-7220-4216-b5a3-c0781c98565a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:08.432218 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-791a3a0b-7220-4216-b5a3-c0781c98565a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:08.442385 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-791a3a0b-7220-4216-b5a3-c0781c98565a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:08.443957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-791a3a0b-7220-4216-b5a3-c0781c98565a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:08.445243 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-791a3a0b-7220-4216-b5a3-c0781c98565a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1745 microversion: 2.20 time: 0.161956 Jul 20 11:42:08.445884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 338/663] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:08 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:09.463874 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8196a02b-6d85-4ef9-9ba1-1152f5b7e2b3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:09.464429 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8196a02b-6d85-4ef9-9ba1-1152f5b7e2b3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:09.470906 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8196a02b-6d85-4ef9-9ba1-1152f5b7e2b3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:09.471349 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8196a02b-6d85-4ef9-9ba1-1152f5b7e2b3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:09.472228 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8196a02b-6d85-4ef9-9ba1-1152f5b7e2b3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:09.472656 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8196a02b-6d85-4ef9-9ba1-1152f5b7e2b3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:09.601373 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8196a02b-6d85-4ef9-9ba1-1152f5b7e2b3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:09.609320 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8196a02b-6d85-4ef9-9ba1-1152f5b7e2b3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:09.610813 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8196a02b-6d85-4ef9-9ba1-1152f5b7e2b3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:09.611943 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8196a02b-6d85-4ef9-9ba1-1152f5b7e2b3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1745 microversion: 2.20 time: 0.152145 Jul 20 11:42:09.612511 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 326/664] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:09 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:10.630143 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-40026b33-cb6b-43e2-b666-6f86d519a055 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:10.630719 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-40026b33-cb6b-43e2-b666-6f86d519a055 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:10.637350 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40026b33-cb6b-43e2-b666-6f86d519a055 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:10.637813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40026b33-cb6b-43e2-b666-6f86d519a055 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:10.638564 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40026b33-cb6b-43e2-b666-6f86d519a055 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:10.638994 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40026b33-cb6b-43e2-b666-6f86d519a055 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:10.765819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-40026b33-cb6b-43e2-b666-6f86d519a055 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:10.773867 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-40026b33-cb6b-43e2-b666-6f86d519a055 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:10.775402 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-40026b33-cb6b-43e2-b666-6f86d519a055 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:10.776542 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-40026b33-cb6b-43e2-b666-6f86d519a055 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1745 microversion: 2.20 time: 0.150331 Jul 20 11:42:10.777669 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 339/665] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:10 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:11.795702 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fce598b8-5245-4025-8533-42ffe352e862 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:11.796307 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fce598b8-5245-4025-8533-42ffe352e862 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:11.802779 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fce598b8-5245-4025-8533-42ffe352e862 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:11.803220 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fce598b8-5245-4025-8533-42ffe352e862 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:11.803980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fce598b8-5245-4025-8533-42ffe352e862 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:11.804408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fce598b8-5245-4025-8533-42ffe352e862 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:11.938717 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fce598b8-5245-4025-8533-42ffe352e862 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:11.946933 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fce598b8-5245-4025-8533-42ffe352e862 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:11.948471 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fce598b8-5245-4025-8533-42ffe352e862 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:11.950422 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fce598b8-5245-4025-8533-42ffe352e862 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1745 microversion: 2.20 time: 0.159124 Jul 20 11:42:11.954871 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 327/666] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:11 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:12.969006 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-133fcd55-e2e8-4667-9c47-ad4405c209c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:12.969612 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-133fcd55-e2e8-4667-9c47-ad4405c209c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:12.976087 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-133fcd55-e2e8-4667-9c47-ad4405c209c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:12.976533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-133fcd55-e2e8-4667-9c47-ad4405c209c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:12.977349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-133fcd55-e2e8-4667-9c47-ad4405c209c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:12.977784 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-133fcd55-e2e8-4667-9c47-ad4405c209c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:13.108250 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-133fcd55-e2e8-4667-9c47-ad4405c209c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:13.115924 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-133fcd55-e2e8-4667-9c47-ad4405c209c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:13.117450 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-133fcd55-e2e8-4667-9c47-ad4405c209c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:13.118586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-133fcd55-e2e8-4667-9c47-ad4405c209c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.153496 Jul 20 11:42:13.119128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 340/667] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:12 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:14.137688 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f2fbbb80-b05e-4d6c-bd1e-358b16befd9c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:14.138227 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f2fbbb80-b05e-4d6c-bd1e-358b16befd9c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:14.144629 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2fbbb80-b05e-4d6c-bd1e-358b16befd9c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:14.145351 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2fbbb80-b05e-4d6c-bd1e-358b16befd9c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:14.146109 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2fbbb80-b05e-4d6c-bd1e-358b16befd9c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:14.146534 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f2fbbb80-b05e-4d6c-bd1e-358b16befd9c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:14.273427 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2fbbb80-b05e-4d6c-bd1e-358b16befd9c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:14.280645 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2fbbb80-b05e-4d6c-bd1e-358b16befd9c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:14.282215 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f2fbbb80-b05e-4d6c-bd1e-358b16befd9c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:14.283395 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f2fbbb80-b05e-4d6c-bd1e-358b16befd9c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.150245 Jul 20 11:42:14.283973 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 328/668] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:14 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:15.302012 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d188c416-15c7-4482-bfec-73ebd6830bea tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:15.302613 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d188c416-15c7-4482-bfec-73ebd6830bea tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:15.309638 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d188c416-15c7-4482-bfec-73ebd6830bea tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:15.310076 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d188c416-15c7-4482-bfec-73ebd6830bea tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:15.310827 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d188c416-15c7-4482-bfec-73ebd6830bea tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:15.311281 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d188c416-15c7-4482-bfec-73ebd6830bea tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:15.440378 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d188c416-15c7-4482-bfec-73ebd6830bea tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:15.448216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d188c416-15c7-4482-bfec-73ebd6830bea tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:15.450405 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d188c416-15c7-4482-bfec-73ebd6830bea tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:15.451560 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d188c416-15c7-4482-bfec-73ebd6830bea tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.153397 Jul 20 11:42:15.452107 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 341/669] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:15 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:16.470869 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-83982fbc-621d-4e6e-b287-cefb5233a1a8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:16.471402 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-83982fbc-621d-4e6e-b287-cefb5233a1a8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:16.477374 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83982fbc-621d-4e6e-b287-cefb5233a1a8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:16.477817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83982fbc-621d-4e6e-b287-cefb5233a1a8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:16.478580 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83982fbc-621d-4e6e-b287-cefb5233a1a8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:16.479015 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-83982fbc-621d-4e6e-b287-cefb5233a1a8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:16.483112 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:16.606864 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-83982fbc-621d-4e6e-b287-cefb5233a1a8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:16.614904 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-83982fbc-621d-4e6e-b287-cefb5233a1a8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:16.616556 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-83982fbc-621d-4e6e-b287-cefb5233a1a8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:16.617745 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-83982fbc-621d-4e6e-b287-cefb5233a1a8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.151340 Jul 20 11:42:16.618307 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 329/670] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:16 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:42:17.306401 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dfdb63a8-8f72-4eaf-859f-d70724aad86c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:17.308026 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dfdb63a8-8f72-4eaf-859f-d70724aad86c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:17.315933 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfdb63a8-8f72-4eaf-859f-d70724aad86c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:17.316313 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfdb63a8-8f72-4eaf-859f-d70724aad86c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:17.317112 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfdb63a8-8f72-4eaf-859f-d70724aad86c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:17.317580 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfdb63a8-8f72-4eaf-859f-d70724aad86c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:17.344214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-dfdb63a8-8f72-4eaf-859f-d70724aad86c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lazy-loading 'flavor' on Instance uuid 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:42:17.626542 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dfdb63a8-8f72-4eaf-859f-d70724aad86c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "POST /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/action" status: 200 len: 32 microversion: 2.1 time: 0.323993 Jul 20 11:42:17.628173 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 342/671] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:42:17 2022] POST /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/action => generated 32 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:42:17.635979 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da8d99b4-194e-415a-9a6b-17504a4dec7a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:17.636617 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-da8d99b4-194e-415a-9a6b-17504a4dec7a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:17.643334 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da8d99b4-194e-415a-9a6b-17504a4dec7a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:17.643989 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da8d99b4-194e-415a-9a6b-17504a4dec7a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:17.644958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da8d99b4-194e-415a-9a6b-17504a4dec7a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:17.645809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da8d99b4-194e-415a-9a6b-17504a4dec7a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:17.655438 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dd5ec962-355e-4196-89f1-19696e8f7eef tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:17.656230 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dd5ec962-355e-4196-89f1-19696e8f7eef tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:17.663881 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd5ec962-355e-4196-89f1-19696e8f7eef tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:17.664560 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd5ec962-355e-4196-89f1-19696e8f7eef tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:17.665376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd5ec962-355e-4196-89f1-19696e8f7eef tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:17.666011 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd5ec962-355e-4196-89f1-19696e8f7eef tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:17.847126 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da8d99b4-194e-415a-9a6b-17504a4dec7a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:17.856486 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da8d99b4-194e-415a-9a6b-17504a4dec7a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:17.858345 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da8d99b4-194e-415a-9a6b-17504a4dec7a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:17.859604 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-da8d99b4-194e-415a-9a6b-17504a4dec7a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.228058 Jul 20 11:42:17.860536 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 330/672] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:17 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:17.887805 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dd5ec962-355e-4196-89f1-19696e8f7eef tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:17.897755 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dd5ec962-355e-4196-89f1-19696e8f7eef tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.254815 Jul 20 11:42:17.898355 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 343/673] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:17 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:18.879745 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-96abcecb-bdc9-4a4c-b530-711c63510b43 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:18.880403 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-96abcecb-bdc9-4a4c-b530-711c63510b43 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:18.889686 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96abcecb-bdc9-4a4c-b530-711c63510b43 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:18.890411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96abcecb-bdc9-4a4c-b530-711c63510b43 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:18.891395 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96abcecb-bdc9-4a4c-b530-711c63510b43 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:18.892021 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-96abcecb-bdc9-4a4c-b530-711c63510b43 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:18.916574 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-baafe5c7-4d2f-415b-91f5-35f9b23d9cbc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:18.917306 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-baafe5c7-4d2f-415b-91f5-35f9b23d9cbc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:18.931720 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-baafe5c7-4d2f-415b-91f5-35f9b23d9cbc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:18.932811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-baafe5c7-4d2f-415b-91f5-35f9b23d9cbc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:18.935914 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-baafe5c7-4d2f-415b-91f5-35f9b23d9cbc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:18.935914 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-baafe5c7-4d2f-415b-91f5-35f9b23d9cbc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:19.135759 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-96abcecb-bdc9-4a4c-b530-711c63510b43 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:19.155721 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-96abcecb-bdc9-4a4c-b530-711c63510b43 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:19.163696 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-96abcecb-bdc9-4a4c-b530-711c63510b43 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:19.166284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-baafe5c7-4d2f-415b-91f5-35f9b23d9cbc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:19.173939 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-96abcecb-bdc9-4a4c-b530-711c63510b43 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.294039 Jul 20 11:42:19.175218 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 331/674] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:18 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:19.178745 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-baafe5c7-4d2f-415b-91f5-35f9b23d9cbc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.267088 Jul 20 11:42:19.189999 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 344/675] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:18 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:42:20.194125 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1887b257-b799-4744-8493-2ab150e30165 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:20.194738 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1887b257-b799-4744-8493-2ab150e30165 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:20.197308 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9b375e29-7f7f-4e25-ae13-a832679cf4e7 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:20.198078 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9b375e29-7f7f-4e25-ae13-a832679cf4e7 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:20.201720 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1887b257-b799-4744-8493-2ab150e30165 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:20.202174 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1887b257-b799-4744-8493-2ab150e30165 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:20.202944 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1887b257-b799-4744-8493-2ab150e30165 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:20.203375 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1887b257-b799-4744-8493-2ab150e30165 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:20.205165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b375e29-7f7f-4e25-ae13-a832679cf4e7 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:20.205623 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b375e29-7f7f-4e25-ae13-a832679cf4e7 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:20.206403 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b375e29-7f7f-4e25-ae13-a832679cf4e7 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:20.206898 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9b375e29-7f7f-4e25-ae13-a832679cf4e7 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:20.403933 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1887b257-b799-4744-8493-2ab150e30165 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:20.406980 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9b375e29-7f7f-4e25-ae13-a832679cf4e7 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:20.412023 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1887b257-b799-4744-8493-2ab150e30165 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:20.413577 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1887b257-b799-4744-8493-2ab150e30165 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:20.418886 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1887b257-b799-4744-8493-2ab150e30165 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.224714 Jul 20 11:42:20.419013 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9b375e29-7f7f-4e25-ae13-a832679cf4e7 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.221533 Jul 20 11:42:20.419124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 332/676] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:20 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:20.419228 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 345/677] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:20 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:21.433344 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-998a6cad-a018-48a8-b7bd-58b619a13928 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:21.434603 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7365f855-3c4d-4b1d-895b-20ee48d186d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:21.434984 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-998a6cad-a018-48a8-b7bd-58b619a13928 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:21.435080 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7365f855-3c4d-4b1d-895b-20ee48d186d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:21.440711 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7365f855-3c4d-4b1d-895b-20ee48d186d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:21.441238 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7365f855-3c4d-4b1d-895b-20ee48d186d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:21.441560 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-998a6cad-a018-48a8-b7bd-58b619a13928 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:21.442009 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7365f855-3c4d-4b1d-895b-20ee48d186d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:21.442156 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-998a6cad-a018-48a8-b7bd-58b619a13928 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:21.442731 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7365f855-3c4d-4b1d-895b-20ee48d186d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:21.442867 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-998a6cad-a018-48a8-b7bd-58b619a13928 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:21.443240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-998a6cad-a018-48a8-b7bd-58b619a13928 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:21.654568 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7365f855-3c4d-4b1d-895b-20ee48d186d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:21.658396 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-998a6cad-a018-48a8-b7bd-58b619a13928 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:21.663755 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7365f855-3c4d-4b1d-895b-20ee48d186d0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.235156 Jul 20 11:42:21.665999 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 333/678] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:21 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:21.667036 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-998a6cad-a018-48a8-b7bd-58b619a13928 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:21.669198 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-998a6cad-a018-48a8-b7bd-58b619a13928 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:21.670525 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-998a6cad-a018-48a8-b7bd-58b619a13928 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.241145 Jul 20 11:42:21.671181 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 346/679] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:21 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:42:22.681823 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f2408c8-da87-4669-9d53-fce1f6e8d4b5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:22.682427 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f2408c8-da87-4669-9d53-fce1f6e8d4b5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:22.689519 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-147ae438-f31d-40e0-974a-e053b08e69db tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:22.689983 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f2408c8-da87-4669-9d53-fce1f6e8d4b5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:22.689983 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f2408c8-da87-4669-9d53-fce1f6e8d4b5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:22.690217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-147ae438-f31d-40e0-974a-e053b08e69db tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:22.690702 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f2408c8-da87-4669-9d53-fce1f6e8d4b5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:22.691131 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f2408c8-da87-4669-9d53-fce1f6e8d4b5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:22.696917 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-147ae438-f31d-40e0-974a-e053b08e69db tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:22.697364 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-147ae438-f31d-40e0-974a-e053b08e69db tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:22.698125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-147ae438-f31d-40e0-974a-e053b08e69db tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:22.698732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-147ae438-f31d-40e0-974a-e053b08e69db tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:22.910548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f2408c8-da87-4669-9d53-fce1f6e8d4b5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:22.927541 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f2408c8-da87-4669-9d53-fce1f6e8d4b5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.249203 Jul 20 11:42:22.928653 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 334/680] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:22 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:22.940154 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-147ae438-f31d-40e0-974a-e053b08e69db tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:22.944582 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-147ae438-f31d-40e0-974a-e053b08e69db tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:22.946414 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-147ae438-f31d-40e0-974a-e053b08e69db tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:22.948084 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-147ae438-f31d-40e0-974a-e053b08e69db tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.262151 Jul 20 11:42:22.949043 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 347/681] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:22 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:23.946745 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-385b8829-f669-4866-88d3-c7670c37499f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:23.947355 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-385b8829-f669-4866-88d3-c7670c37499f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:23.954230 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-385b8829-f669-4866-88d3-c7670c37499f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:23.954676 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-385b8829-f669-4866-88d3-c7670c37499f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:23.955705 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-385b8829-f669-4866-88d3-c7670c37499f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:23.956343 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-385b8829-f669-4866-88d3-c7670c37499f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:23.967365 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9ddc700e-6a76-41c7-b69f-d582793a087f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:23.968679 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9ddc700e-6a76-41c7-b69f-d582793a087f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:23.975240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ddc700e-6a76-41c7-b69f-d582793a087f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:23.975957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ddc700e-6a76-41c7-b69f-d582793a087f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:23.976978 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ddc700e-6a76-41c7-b69f-d582793a087f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:23.977609 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ddc700e-6a76-41c7-b69f-d582793a087f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:24.180525 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9ddc700e-6a76-41c7-b69f-d582793a087f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:24.182489 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-385b8829-f669-4866-88d3-c7670c37499f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:24.195078 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-385b8829-f669-4866-88d3-c7670c37499f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.252102 Jul 20 11:42:24.195319 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9ddc700e-6a76-41c7-b69f-d582793a087f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:24.196927 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9ddc700e-6a76-41c7-b69f-d582793a087f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:24.198159 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9ddc700e-6a76-41c7-b69f-d582793a087f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.234619 Jul 20 11:42:24.205293 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 335/682] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:23 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:24.212030 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 348/683] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:23 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:42:25.213506 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2336ba77-7268-4c9f-ba7d-caabd0a3f43f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:25.213506 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2336ba77-7268-4c9f-ba7d-caabd0a3f43f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:25.218899 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2336ba77-7268-4c9f-ba7d-caabd0a3f43f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:25.219390 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2336ba77-7268-4c9f-ba7d-caabd0a3f43f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:25.219597 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a9ace540-199c-4765-a1cb-fa43cc171bf0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:25.220160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2336ba77-7268-4c9f-ba7d-caabd0a3f43f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:25.220302 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a9ace540-199c-4765-a1cb-fa43cc171bf0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:25.220916 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2336ba77-7268-4c9f-ba7d-caabd0a3f43f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:25.227351 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9ace540-199c-4765-a1cb-fa43cc171bf0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:25.227734 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9ace540-199c-4765-a1cb-fa43cc171bf0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:25.228488 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9ace540-199c-4765-a1cb-fa43cc171bf0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:25.228954 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9ace540-199c-4765-a1cb-fa43cc171bf0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:25.706806 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2336ba77-7268-4c9f-ba7d-caabd0a3f43f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:25.715196 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2336ba77-7268-4c9f-ba7d-caabd0a3f43f tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.507652 Jul 20 11:42:25.719891 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 336/684] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:25 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:25.735483 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a9ace540-199c-4765-a1cb-fa43cc171bf0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:25.745039 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a9ace540-199c-4765-a1cb-fa43cc171bf0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:25.746737 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a9ace540-199c-4765-a1cb-fa43cc171bf0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:25.747910 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a9ace540-199c-4765-a1cb-fa43cc171bf0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.532235 Jul 20 11:42:25.748461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 349/685] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:25 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:42:26.743313 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9cc45e10-7eea-42a0-9b92-6144aa49e380 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:26.747228 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9cc45e10-7eea-42a0-9b92-6144aa49e380 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:26.754069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cc45e10-7eea-42a0-9b92-6144aa49e380 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:26.754515 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cc45e10-7eea-42a0-9b92-6144aa49e380 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:26.755314 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cc45e10-7eea-42a0-9b92-6144aa49e380 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:26.755889 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9cc45e10-7eea-42a0-9b92-6144aa49e380 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:26.768599 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-df7b9aff-b921-4601-9449-1d93e5006987 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:26.769386 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-df7b9aff-b921-4601-9449-1d93e5006987 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:26.776554 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df7b9aff-b921-4601-9449-1d93e5006987 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:26.777119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df7b9aff-b921-4601-9449-1d93e5006987 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:26.777986 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df7b9aff-b921-4601-9449-1d93e5006987 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:26.778502 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df7b9aff-b921-4601-9449-1d93e5006987 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:26.955009 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9cc45e10-7eea-42a0-9b92-6144aa49e380 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:26.965065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9cc45e10-7eea-42a0-9b92-6144aa49e380 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.226983 Jul 20 11:42:26.966535 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 337/686] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:26 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:27.015016 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-df7b9aff-b921-4601-9449-1d93e5006987 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:27.023830 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-df7b9aff-b921-4601-9449-1d93e5006987 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:27.027090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-df7b9aff-b921-4601-9449-1d93e5006987 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:27.028486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-df7b9aff-b921-4601-9449-1d93e5006987 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.263964 Jul 20 11:42:27.035923 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 350/687] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:26 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:42:27.983328 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bd776c42-4425-4da9-b8fa-914c988aef2a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:27.983940 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bd776c42-4425-4da9-b8fa-914c988aef2a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:27.990589 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd776c42-4425-4da9-b8fa-914c988aef2a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:27.991037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd776c42-4425-4da9-b8fa-914c988aef2a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:27.991818 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd776c42-4425-4da9-b8fa-914c988aef2a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:27.992255 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd776c42-4425-4da9-b8fa-914c988aef2a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:28.052180 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fb08555e-14df-4930-a6fa-e73d7ac8b6b6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:28.053586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fb08555e-14df-4930-a6fa-e73d7ac8b6b6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:28.060424 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb08555e-14df-4930-a6fa-e73d7ac8b6b6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:28.060993 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb08555e-14df-4930-a6fa-e73d7ac8b6b6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:28.061839 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb08555e-14df-4930-a6fa-e73d7ac8b6b6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:28.062491 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb08555e-14df-4930-a6fa-e73d7ac8b6b6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:28.164669 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bd776c42-4425-4da9-b8fa-914c988aef2a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:28.176689 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bd776c42-4425-4da9-b8fa-914c988aef2a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.197755 Jul 20 11:42:28.177544 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 338/688] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:27 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:28.225362 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fb08555e-14df-4930-a6fa-e73d7ac8b6b6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:28.234193 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fb08555e-14df-4930-a6fa-e73d7ac8b6b6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:28.235687 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fb08555e-14df-4930-a6fa-e73d7ac8b6b6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:28.236863 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fb08555e-14df-4930-a6fa-e73d7ac8b6b6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.189748 Jul 20 11:42:28.237444 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 351/689] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:28 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:29.194753 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e7c98c27-f74a-4028-8745-dc8c032018bc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:29.196205 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e7c98c27-f74a-4028-8745-dc8c032018bc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:29.204013 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7c98c27-f74a-4028-8745-dc8c032018bc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:29.204670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7c98c27-f74a-4028-8745-dc8c032018bc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:29.205782 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7c98c27-f74a-4028-8745-dc8c032018bc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:29.206195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7c98c27-f74a-4028-8745-dc8c032018bc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:29.255629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-14fba219-9ea8-410b-aece-27a0c67b9a24 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:29.257852 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-14fba219-9ea8-410b-aece-27a0c67b9a24 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:29.264370 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14fba219-9ea8-410b-aece-27a0c67b9a24 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:29.264855 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14fba219-9ea8-410b-aece-27a0c67b9a24 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:29.265637 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14fba219-9ea8-410b-aece-27a0c67b9a24 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:29.266073 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14fba219-9ea8-410b-aece-27a0c67b9a24 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:29.270330 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:29.411653 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e7c98c27-f74a-4028-8745-dc8c032018bc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:29.419513 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e7c98c27-f74a-4028-8745-dc8c032018bc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.229328 Jul 20 11:42:29.420083 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 339/690] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:29 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:29.429054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-14fba219-9ea8-410b-aece-27a0c67b9a24 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:29.438427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-14fba219-9ea8-410b-aece-27a0c67b9a24 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:29.439369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-14fba219-9ea8-410b-aece-27a0c67b9a24 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:29.440514 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-14fba219-9ea8-410b-aece-27a0c67b9a24 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.189103 Jul 20 11:42:29.441097 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 352/691] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:29 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:30.441253 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1acb4cb6-9228-4a2b-a267-8a838971c717 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:30.441924 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1acb4cb6-9228-4a2b-a267-8a838971c717 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:30.455883 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1acb4cb6-9228-4a2b-a267-8a838971c717 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:30.456338 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1acb4cb6-9228-4a2b-a267-8a838971c717 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:30.457238 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1acb4cb6-9228-4a2b-a267-8a838971c717 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:30.457607 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1acb4cb6-9228-4a2b-a267-8a838971c717 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:30.462472 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-07fc46e3-6436-40cb-9326-39e593842869 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:30.462472 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-07fc46e3-6436-40cb-9326-39e593842869 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:30.477134 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07fc46e3-6436-40cb-9326-39e593842869 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:30.477863 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07fc46e3-6436-40cb-9326-39e593842869 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:30.479945 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07fc46e3-6436-40cb-9326-39e593842869 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:30.480488 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07fc46e3-6436-40cb-9326-39e593842869 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:30.691883 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1acb4cb6-9228-4a2b-a267-8a838971c717 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:30.698745 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-07fc46e3-6436-40cb-9326-39e593842869 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:30.702157 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1acb4cb6-9228-4a2b-a267-8a838971c717 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.266987 Jul 20 11:42:30.702157 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 340/692] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:30 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:30.707181 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-07fc46e3-6436-40cb-9326-39e593842869 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:30.708691 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-07fc46e3-6436-40cb-9326-39e593842869 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:30.709870 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-07fc46e3-6436-40cb-9326-39e593842869 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.254267 Jul 20 11:42:30.710412 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 353/693] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:30 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:31.717982 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-44c0cec3-0831-4eed-88ad-b4733cfc3153 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:31.718657 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-44c0cec3-0831-4eed-88ad-b4733cfc3153 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:31.725521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44c0cec3-0831-4eed-88ad-b4733cfc3153 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:31.725966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44c0cec3-0831-4eed-88ad-b4733cfc3153 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:31.727183 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44c0cec3-0831-4eed-88ad-b4733cfc3153 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:31.727625 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-44c0cec3-0831-4eed-88ad-b4733cfc3153 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:31.727925 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-28998a57-f1dc-41da-a9c3-151195938961 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:31.728546 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-28998a57-f1dc-41da-a9c3-151195938961 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:31.735293 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28998a57-f1dc-41da-a9c3-151195938961 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:31.735739 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28998a57-f1dc-41da-a9c3-151195938961 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:31.736516 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28998a57-f1dc-41da-a9c3-151195938961 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:31.736981 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-28998a57-f1dc-41da-a9c3-151195938961 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:31.926908 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-44c0cec3-0831-4eed-88ad-b4733cfc3153 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:31.929516 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-28998a57-f1dc-41da-a9c3-151195938961 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:31.935918 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-44c0cec3-0831-4eed-88ad-b4733cfc3153 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.222160 Jul 20 11:42:31.936536 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 341/694] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:31 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:31.937560 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-28998a57-f1dc-41da-a9c3-151195938961 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:31.939073 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-28998a57-f1dc-41da-a9c3-151195938961 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:31.940227 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-28998a57-f1dc-41da-a9c3-151195938961 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1740 microversion: 2.20 time: 0.216535 Jul 20 11:42:31.940774 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 354/695] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:31 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:42:32.954327 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c6ff2ecd-93b3-48c7-b8a6-f57ac497944b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:32.954990 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c6ff2ecd-93b3-48c7-b8a6-f57ac497944b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:32.958404 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a7d79707-e096-48a1-a325-503b90201c81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:32.959128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a7d79707-e096-48a1-a325-503b90201c81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:32.961493 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6ff2ecd-93b3-48c7-b8a6-f57ac497944b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:32.961649 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=42 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:32.961937 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6ff2ecd-93b3-48c7-b8a6-f57ac497944b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:32.962697 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6ff2ecd-93b3-48c7-b8a6-f57ac497944b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:32.963125 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6ff2ecd-93b3-48c7-b8a6-f57ac497944b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:32.966346 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7d79707-e096-48a1-a325-503b90201c81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:32.966833 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7d79707-e096-48a1-a325-503b90201c81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:32.968170 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7d79707-e096-48a1-a325-503b90201c81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:32.968555 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a7d79707-e096-48a1-a325-503b90201c81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:33.239077 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a7d79707-e096-48a1-a325-503b90201c81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:33.242800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c6ff2ecd-93b3-48c7-b8a6-f57ac497944b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:33.249245 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a7d79707-e096-48a1-a325-503b90201c81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:33.250791 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a7d79707-e096-48a1-a325-503b90201c81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:33.251969 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a7d79707-e096-48a1-a325-503b90201c81 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1722 microversion: 2.20 time: 0.297746 Jul 20 11:42:33.252726 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 355/696] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:32 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:42:33.256346 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c6ff2ecd-93b3-48c7-b8a6-f57ac497944b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.303090 Jul 20 11:42:33.256346 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 342/697] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:32 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:34.271276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-24f251bb-c088-4194-aa3a-65a1885a28d5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:34.271943 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2c03376-b541-4065-be24-0751adfa2d91 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:34.272937 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-24f251bb-c088-4194-aa3a-65a1885a28d5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:34.273151 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2c03376-b541-4065-be24-0751adfa2d91 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:34.281358 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2c03376-b541-4065-be24-0751adfa2d91 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:34.282796 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2c03376-b541-4065-be24-0751adfa2d91 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:34.283225 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2c03376-b541-4065-be24-0751adfa2d91 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:34.283815 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2c03376-b541-4065-be24-0751adfa2d91 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:34.284750 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24f251bb-c088-4194-aa3a-65a1885a28d5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:34.285485 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24f251bb-c088-4194-aa3a-65a1885a28d5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:34.286368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24f251bb-c088-4194-aa3a-65a1885a28d5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:34.287024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-24f251bb-c088-4194-aa3a-65a1885a28d5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:34.601754 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2c03376-b541-4065-be24-0751adfa2d91 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:34.610454 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2c03376-b541-4065-be24-0751adfa2d91 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:34.611959 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2c03376-b541-4065-be24-0751adfa2d91 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:34.613133 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2c03376-b541-4065-be24-0751adfa2d91 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1722 microversion: 2.20 time: 0.346267 Jul 20 11:42:34.613692 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 343/698] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:34 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:34.618412 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-fc45ea7f-78c5-459a-aa12-0d8b3d2f0581 req-dc680146-b1f7-4bc4-a38f-9cd21703a0ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3abfd3-22be-4728-9006-19ad38c1bd9c", "name": "network-vif-unplugged", "status": "completed", "tag": "e605e30c-d865-4978-9798-9dc53408552e"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:34.623999 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-24f251bb-c088-4194-aa3a-65a1885a28d5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:34.627208 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-fc45ea7f-78c5-459a-aa12-0d8b3d2f0581 req-dc680146-b1f7-4bc4-a38f-9cd21703a0ff service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:34.633256 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-fc45ea7f-78c5-459a-aa12-0d8b3d2f0581 req-dc680146-b1f7-4bc4-a38f-9cd21703a0ff service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:34.637352 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-24f251bb-c088-4194-aa3a-65a1885a28d5 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.370624 Jul 20 11:42:34.639332 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 356/699] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:34 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:34.650919 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-fc45ea7f-78c5-459a-aa12-0d8b3d2f0581 req-dc680146-b1f7-4bc4-a38f-9cd21703a0ff service nova] Creating event network-vif-unplugged:e605e30c-d865-4978-9798-9dc53408552e for instance ea3abfd3-22be-4728-9006-19ad38c1bd9c on hv-cinder-82282 Jul 20 11:42:34.657112 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-fc45ea7f-78c5-459a-aa12-0d8b3d2f0581 req-dc680146-b1f7-4bc4-a38f-9cd21703a0ff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042270 Jul 20 11:42:34.660463 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 344/700] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:42:35.632618 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-120c42ad-7553-4593-b985-630bcc70ff11 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:35.633258 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-120c42ad-7553-4593-b985-630bcc70ff11 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:35.640919 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-120c42ad-7553-4593-b985-630bcc70ff11 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:35.641366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-120c42ad-7553-4593-b985-630bcc70ff11 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:35.642138 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-120c42ad-7553-4593-b985-630bcc70ff11 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:35.642567 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-120c42ad-7553-4593-b985-630bcc70ff11 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:35.659655 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04138d94-ebd1-4cdc-9061-a0b6739ef952 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:35.660490 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-04138d94-ebd1-4cdc-9061-a0b6739ef952 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:35.673254 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04138d94-ebd1-4cdc-9061-a0b6739ef952 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:35.674226 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04138d94-ebd1-4cdc-9061-a0b6739ef952 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:35.675516 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04138d94-ebd1-4cdc-9061-a0b6739ef952 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:35.676149 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04138d94-ebd1-4cdc-9061-a0b6739ef952 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:36.039869 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-120c42ad-7553-4593-b985-630bcc70ff11 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:36.046285 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04138d94-ebd1-4cdc-9061-a0b6739ef952 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:36.050837 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-120c42ad-7553-4593-b985-630bcc70ff11 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:36.053669 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-120c42ad-7553-4593-b985-630bcc70ff11 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:36.054927 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-04138d94-ebd1-4cdc-9061-a0b6739ef952 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.402714 Jul 20 11:42:36.056766 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-120c42ad-7553-4593-b985-630bcc70ff11 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1725 microversion: 2.20 time: 0.427109 Jul 20 11:42:36.057616 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 357/701] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:35 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1725 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:36.064930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 345/702] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:35 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:36.078960 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f33bdd3c-0338-48d1-b113-8e6d4de6d417 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63da3e7c-cb46-4960-96aa-a576696c7ee4"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:36.080366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f33bdd3c-0338-48d1-b113-8e6d4de6d417 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:36.086712 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f33bdd3c-0338-48d1-b113-8e6d4de6d417 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:36.087163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f33bdd3c-0338-48d1-b113-8e6d4de6d417 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:36.088002 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f33bdd3c-0338-48d1-b113-8e6d4de6d417 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:36.088432 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f33bdd3c-0338-48d1-b113-8e6d4de6d417 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:37.071849 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-945734c2-59a9-4f6a-a804-60c8545407fc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:37.072361 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-945734c2-59a9-4f6a-a804-60c8545407fc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:37.076087 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=44 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:37.080133 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-945734c2-59a9-4f6a-a804-60c8545407fc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:37.080645 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-945734c2-59a9-4f6a-a804-60c8545407fc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:37.081618 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-945734c2-59a9-4f6a-a804-60c8545407fc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:37.082044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-945734c2-59a9-4f6a-a804-60c8545407fc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:37.101690 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:37.182976 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f33bdd3c-0338-48d1-b113-8e6d4de6d417 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "POST /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.108021 Jul 20 11:42:37.184357 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 358/703] 10.222.0.43 () {62 vars in 1363 bytes} [Wed Jul 20 11:42:36 2022] POST /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments => generated 188 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 11:42:37.343833 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-945734c2-59a9-4f6a-a804-60c8545407fc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:37.354556 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-945734c2-59a9-4f6a-a804-60c8545407fc tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.286822 Jul 20 11:42:37.355378 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 346/704] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:37 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:42:37.367273 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-396edf85-822e-4dc2-9241-5ec2023baed2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:37.368155 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-396edf85-822e-4dc2-9241-5ec2023baed2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:37.381359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-396edf85-822e-4dc2-9241-5ec2023baed2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:37.382638 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-396edf85-822e-4dc2-9241-5ec2023baed2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:37.384374 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-396edf85-822e-4dc2-9241-5ec2023baed2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:37.385200 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-396edf85-822e-4dc2-9241-5ec2023baed2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:37.762283 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-396edf85-822e-4dc2-9241-5ec2023baed2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "POST /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/action" status: 202 len: 0 microversion: 2.20 time: 0.414487 Jul 20 11:42:37.763099 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 359/705] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jul 20 11:42:37 2022] POST /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:42:37.772768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-15710fc9-59d2-49fe-9146-efc49a97ce16 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:37.773941 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-15710fc9-59d2-49fe-9146-efc49a97ce16 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:37.781646 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15710fc9-59d2-49fe-9146-efc49a97ce16 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:37.782265 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15710fc9-59d2-49fe-9146-efc49a97ce16 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:37.783220 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15710fc9-59d2-49fe-9146-efc49a97ce16 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:37.783980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-15710fc9-59d2-49fe-9146-efc49a97ce16 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:37.932622 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-15710fc9-59d2-49fe-9146-efc49a97ce16 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:37.944221 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-15710fc9-59d2-49fe-9146-efc49a97ce16 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:37.946076 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-15710fc9-59d2-49fe-9146-efc49a97ce16 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:37.947773 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-15710fc9-59d2-49fe-9146-efc49a97ce16 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1751 microversion: 2.20 time: 0.179927 Jul 20 11:42:37.949077 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 347/706] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:37 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:38.372521 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7aedd874-77ba-4d7a-ac93-8359b0f130e0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:38.373761 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7aedd874-77ba-4d7a-ac93-8359b0f130e0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:38.380604 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aedd874-77ba-4d7a-ac93-8359b0f130e0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:38.381162 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aedd874-77ba-4d7a-ac93-8359b0f130e0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:38.382166 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aedd874-77ba-4d7a-ac93-8359b0f130e0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:38.382587 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7aedd874-77ba-4d7a-ac93-8359b0f130e0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:38.569601 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7aedd874-77ba-4d7a-ac93-8359b0f130e0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:38.578509 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7aedd874-77ba-4d7a-ac93-8359b0f130e0 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1735 microversion: 2.1 time: 0.210898 Jul 20 11:42:38.579834 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 360/707] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:38 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:38.976597 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2893807d-5df4-499e-9bab-07282248ffc8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:38.978278 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2893807d-5df4-499e-9bab-07282248ffc8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:38.986023 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2893807d-5df4-499e-9bab-07282248ffc8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:38.995424 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2893807d-5df4-499e-9bab-07282248ffc8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:38.995424 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2893807d-5df4-499e-9bab-07282248ffc8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:38.995424 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2893807d-5df4-499e-9bab-07282248ffc8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:39.131347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2893807d-5df4-499e-9bab-07282248ffc8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:39.139629 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2893807d-5df4-499e-9bab-07282248ffc8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:39.141149 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2893807d-5df4-499e-9bab-07282248ffc8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:39.142432 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2893807d-5df4-499e-9bab-07282248ffc8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1751 microversion: 2.20 time: 0.178272 Jul 20 11:42:39.142962 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 348/708] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:38 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:39.600258 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7c94c30c-75c4-4f65-a27b-f01708c8adc2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:39.602285 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7c94c30c-75c4-4f65-a27b-f01708c8adc2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:39.611252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c94c30c-75c4-4f65-a27b-f01708c8adc2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:39.611961 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c94c30c-75c4-4f65-a27b-f01708c8adc2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:39.613939 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c94c30c-75c4-4f65-a27b-f01708c8adc2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:39.616999 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7c94c30c-75c4-4f65-a27b-f01708c8adc2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:39.764611 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7c94c30c-75c4-4f65-a27b-f01708c8adc2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:39.774325 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7c94c30c-75c4-4f65-a27b-f01708c8adc2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1715 microversion: 2.1 time: 0.180386 Jul 20 11:42:39.774902 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 361/709] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:39 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1715 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:39.900159 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6db675e7-4cf8-49b3-9491-d6efeb45c391 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:39.900932 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6db675e7-4cf8-49b3-9491-d6efeb45c391 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:39.907972 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6db675e7-4cf8-49b3-9491-d6efeb45c391 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:39.908529 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6db675e7-4cf8-49b3-9491-d6efeb45c391 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:39.909580 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6db675e7-4cf8-49b3-9491-d6efeb45c391 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:39.910176 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6db675e7-4cf8-49b3-9491-d6efeb45c391 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:40.007975 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-6db675e7-4cf8-49b3-9491-d6efeb45c391 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] HTTP exception thrown: Cannot 'detach_volume' instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 while it is in vm_state rescued Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6db675e7-4cf8-49b3-9491-d6efeb45c391 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Request method failure captured: Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-volume_attachments/ce74fc08-4dfb-45ff-b938-25c7c8148369 HTTP/1.1 Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-iAGi3InK9o5h93wuwA0y5ZKhv9_XAKhliB9WFK5RjT5ZrOF0JJYFYjtkeiIwNODHDo_KnrpGsMdR8pcBx5HCYKHdHD5VuyuH1iNl2gS4aXxblQodWvSpFJzhwU9a0ybd_eXdwbZ98_NuT-Y4ohecR6FqVlVYRBJMZgmzEOLlYCO8M Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: 9192fe06f92b47cfbc286bb76e97410b Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:42:40.009998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:42:40.011642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9192fe06f92b47cfbc286bb76e97410b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9192fe06f92b47cfbc286bb76e97410b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9192fe06f92b47cfbc286bb76e97410b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9192fe06f92b47cfbc286bb76e97410b"}]}] Jul 20 11:42:40.011642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:42:40.011642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 9192fe06f92b47cfbc286bb76e97410b Jul 20 11:42:40.011642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:42:40.011642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-ServerRescueNegativeTestJSON-260660390-project Jul 20 11:42:40.011642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:42:40.011642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:42:40.011642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 51876164aea741cc873ba4755e6c6fcd Jul 20 11:42:40.011642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-ServerRescueNegativeTestJSON-260660390-project Jul 20 11:42:40.011642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:42:40.011642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Cannot 'detach_volume' instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 while it is in vm_state rescued Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'server_id': '78cd1446-9e8f-4683-8f7f-1be9fff0bc94', 'id': 'ce74fc08-4dfb-45ff-b938-25c7c8148369'} Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:42:40.012553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 while it is in vm_state rescued Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 while it is in vm_state rescued Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:42:40.014098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6db675e7-4cf8-49b3-9491-d6efeb45c391 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Returning 409 to user: Cannot 'detach_volume' instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 while it is in vm_state rescued {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:42:40.015090 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6db675e7-4cf8-49b3-9491-d6efeb45c391 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "DELETE /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-volume_attachments/ce74fc08-4dfb-45ff-b938-25c7c8148369" status: 409 len: 152 microversion: 2.1 time: 0.116304 Jul 20 11:42:40.015090 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 349/710] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 11:42:39 2022] DELETE /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-volume_attachments/ce74fc08-4dfb-45ff-b938-25c7c8148369 => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:42:40.021638 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c2069872-df96-4578-b5aa-0d538d49c2ff tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:40.022176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c2069872-df96-4578-b5aa-0d538d49c2ff tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:40.028795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2069872-df96-4578-b5aa-0d538d49c2ff tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:40.030064 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2069872-df96-4578-b5aa-0d538d49c2ff tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:40.031451 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2069872-df96-4578-b5aa-0d538d49c2ff tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:40.031890 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c2069872-df96-4578-b5aa-0d538d49c2ff tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:40.161352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b4af77bd-08c9-4b0a-a406-f238bd17ea2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:40.161963 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b4af77bd-08c9-4b0a-a406-f238bd17ea2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:40.171604 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4af77bd-08c9-4b0a-a406-f238bd17ea2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:40.172056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4af77bd-08c9-4b0a-a406-f238bd17ea2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:40.172867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4af77bd-08c9-4b0a-a406-f238bd17ea2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:40.173485 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b4af77bd-08c9-4b0a-a406-f238bd17ea2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:40.291947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c2069872-df96-4578-b5aa-0d538d49c2ff tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "POST /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/action" status: 202 len: 0 microversion: 2.1 time: 0.274622 Jul 20 11:42:40.296335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 362/711] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:42:40 2022] POST /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:42:40.301937 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cf674889-bc24-42e9-b9a5-ba1b1519efab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:40.302866 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cf674889-bc24-42e9-b9a5-ba1b1519efab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:40.311596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf674889-bc24-42e9-b9a5-ba1b1519efab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:40.312045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf674889-bc24-42e9-b9a5-ba1b1519efab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:40.313170 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf674889-bc24-42e9-b9a5-ba1b1519efab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:40.313823 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf674889-bc24-42e9-b9a5-ba1b1519efab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:40.346095 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b4af77bd-08c9-4b0a-a406-f238bd17ea2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:40.354893 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b4af77bd-08c9-4b0a-a406-f238bd17ea2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:40.356619 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b4af77bd-08c9-4b0a-a406-f238bd17ea2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:40.358486 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b4af77bd-08c9-4b0a-a406-f238bd17ea2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1753 microversion: 2.20 time: 0.201059 Jul 20 11:42:40.359227 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 350/712] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:40 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1753 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:40.578463 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf674889-bc24-42e9-b9a5-ba1b1519efab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:40.588541 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cf674889-bc24-42e9-b9a5-ba1b1519efab tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1723 microversion: 2.1 time: 0.290662 Jul 20 11:42:40.589636 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 363/713] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:40 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:41.381511 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba18e4e3-6c0f-4e8d-81c0-ae30c49f7751 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:41.382869 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ba18e4e3-6c0f-4e8d-81c0-ae30c49f7751 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:41.390181 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba18e4e3-6c0f-4e8d-81c0-ae30c49f7751 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:41.390806 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba18e4e3-6c0f-4e8d-81c0-ae30c49f7751 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:41.391743 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba18e4e3-6c0f-4e8d-81c0-ae30c49f7751 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:41.392471 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba18e4e3-6c0f-4e8d-81c0-ae30c49f7751 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:41.606294 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-057f58ef-f96a-4d62-b0e6-b47e4d4299d9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:41.608033 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-057f58ef-f96a-4d62-b0e6-b47e4d4299d9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:41.617461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-057f58ef-f96a-4d62-b0e6-b47e4d4299d9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:41.618135 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-057f58ef-f96a-4d62-b0e6-b47e4d4299d9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:41.619117 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-057f58ef-f96a-4d62-b0e6-b47e4d4299d9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:41.619740 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-057f58ef-f96a-4d62-b0e6-b47e4d4299d9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:41.625543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:41.715907 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba18e4e3-6c0f-4e8d-81c0-ae30c49f7751 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:41.732177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba18e4e3-6c0f-4e8d-81c0-ae30c49f7751 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:41.737198 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ba18e4e3-6c0f-4e8d-81c0-ae30c49f7751 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:41.738747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba18e4e3-6c0f-4e8d-81c0-ae30c49f7751 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1753 microversion: 2.20 time: 0.361276 Jul 20 11:42:41.739804 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 351/714] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:41 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1753 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:41.930270 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-057f58ef-f96a-4d62-b0e6-b47e4d4299d9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:41.941131 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-057f58ef-f96a-4d62-b0e6-b47e4d4299d9 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1723 microversion: 2.1 time: 0.338519 Jul 20 11:42:41.941889 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 364/715] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:41 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:42:42.757816 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d9713411-aca9-4b7a-8c89-2546a432f2a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:42.758488 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d9713411-aca9-4b7a-8c89-2546a432f2a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:42.766809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9713411-aca9-4b7a-8c89-2546a432f2a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:42.767424 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9713411-aca9-4b7a-8c89-2546a432f2a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:42.768289 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9713411-aca9-4b7a-8c89-2546a432f2a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:42.768824 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d9713411-aca9-4b7a-8c89-2546a432f2a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:42.959939 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7970c3e1-a79f-4595-9c67-6e64ff291124 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:42.961271 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7970c3e1-a79f-4595-9c67-6e64ff291124 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:42.971315 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7970c3e1-a79f-4595-9c67-6e64ff291124 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:42.972026 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7970c3e1-a79f-4595-9c67-6e64ff291124 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:42.974072 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7970c3e1-a79f-4595-9c67-6e64ff291124 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:42.974072 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7970c3e1-a79f-4595-9c67-6e64ff291124 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:43.272791 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d9713411-aca9-4b7a-8c89-2546a432f2a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:43.284320 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7970c3e1-a79f-4595-9c67-6e64ff291124 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:43.293380 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7970c3e1-a79f-4595-9c67-6e64ff291124 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1723 microversion: 2.1 time: 0.337601 Jul 20 11:42:43.294304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 365/716] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:42 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:43.306414 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d9713411-aca9-4b7a-8c89-2546a432f2a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:43.309850 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d9713411-aca9-4b7a-8c89-2546a432f2a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:43.309850 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d9713411-aca9-4b7a-8c89-2546a432f2a5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1753 microversion: 2.20 time: 0.555905 Jul 20 11:42:43.310322 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 352/717] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:42 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1753 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:44.310937 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c848c238-f38d-4547-b73b-87a420db8ed4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:44.312260 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c848c238-f38d-4547-b73b-87a420db8ed4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:44.320288 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c848c238-f38d-4547-b73b-87a420db8ed4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:44.320927 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c848c238-f38d-4547-b73b-87a420db8ed4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:44.323763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c848c238-f38d-4547-b73b-87a420db8ed4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:44.324224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c848c238-f38d-4547-b73b-87a420db8ed4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:44.332173 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-02e2018b-0642-4bde-b753-985e493098d7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:44.333335 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-02e2018b-0642-4bde-b753-985e493098d7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:44.340579 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02e2018b-0642-4bde-b753-985e493098d7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:44.341404 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02e2018b-0642-4bde-b753-985e493098d7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:44.343019 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02e2018b-0642-4bde-b753-985e493098d7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:44.343677 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-02e2018b-0642-4bde-b753-985e493098d7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:44.597639 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c848c238-f38d-4547-b73b-87a420db8ed4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:44.603589 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-02e2018b-0642-4bde-b753-985e493098d7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:44.606745 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c848c238-f38d-4547-b73b-87a420db8ed4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1723 microversion: 2.1 time: 0.299623 Jul 20 11:42:44.607337 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 366/718] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:44 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:44.624496 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-02e2018b-0642-4bde-b753-985e493098d7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:44.627251 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-02e2018b-0642-4bde-b753-985e493098d7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:44.628427 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-02e2018b-0642-4bde-b753-985e493098d7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.303943 Jul 20 11:42:44.629010 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 353/719] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:44 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:45.624982 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b9ece11b-1c4f-474f-a963-cb502052b17c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:45.625585 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b9ece11b-1c4f-474f-a963-cb502052b17c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:45.633063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9ece11b-1c4f-474f-a963-cb502052b17c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:45.634193 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9ece11b-1c4f-474f-a963-cb502052b17c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:45.636636 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9ece11b-1c4f-474f-a963-cb502052b17c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:45.637486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9ece11b-1c4f-474f-a963-cb502052b17c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:45.652197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1104e89a-0b86-4296-a556-46c779101ff4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:45.652848 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1104e89a-0b86-4296-a556-46c779101ff4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:45.660637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1104e89a-0b86-4296-a556-46c779101ff4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:45.661508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1104e89a-0b86-4296-a556-46c779101ff4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:45.662444 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1104e89a-0b86-4296-a556-46c779101ff4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:45.664448 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1104e89a-0b86-4296-a556-46c779101ff4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:45.908357 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b9ece11b-1c4f-474f-a963-cb502052b17c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:45.915938 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1104e89a-0b86-4296-a556-46c779101ff4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:45.916727 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b9ece11b-1c4f-474f-a963-cb502052b17c tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1729 microversion: 2.1 time: 0.296970 Jul 20 11:42:45.922836 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 367/720] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:45 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1729 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:45.925648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1104e89a-0b86-4296-a556-46c779101ff4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:45.927208 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1104e89a-0b86-4296-a556-46c779101ff4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:45.928527 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1104e89a-0b86-4296-a556-46c779101ff4 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.284808 Jul 20 11:42:45.934244 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 354/721] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:45 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:45.943658 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2593108c-4797-4c6a-85f9-cc752e75d256 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:45.944388 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2593108c-4797-4c6a-85f9-cc752e75d256 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:45.951885 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2593108c-4797-4c6a-85f9-cc752e75d256 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:45.952611 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2593108c-4797-4c6a-85f9-cc752e75d256 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:45.953423 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2593108c-4797-4c6a-85f9-cc752e75d256 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:45.953856 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2593108c-4797-4c6a-85f9-cc752e75d256 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:46.072820 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2593108c-4797-4c6a-85f9-cc752e75d256 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132860 Jul 20 11:42:46.074229 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 355/722] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 11:42:45 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:42:46.183066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f9fcb5f0-37e4-486d-97d9-dc6695451a9f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Action: 'create', calling method: .version_select at 0x7f44e01a3c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-443586517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRfMxdSReHK5vu3jexeEzcpJ2Os0JF/D7Qy9x1S44LI5KhN9MrJaLz7XcX2npqV/m8qVCvv6mskwAdgNv7/xaHY83VCfS9WF2FlEy6mlp+tQtabXcbZHS1qDqZr8HZjlA=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:46.201271 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-f9fcb5f0-37e4-486d-97d9-dc6695451a9f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Getting quotas for project fb6890ad12fa47eeb3cc29dbec41dbe2. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:42:46.206599 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-f9fcb5f0-37e4-486d-97d9-dc6695451a9f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Getting quotas for user a32c5062f269416d9345c2ea2c6f85b6 and project fb6890ad12fa47eeb3cc29dbec41dbe2. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:42:46.298458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f9fcb5f0-37e4-486d-97d9-dc6695451a9f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.374310 Jul 20 11:42:46.299057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 368/723] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 11:42:45 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:42:46.953909 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e2d701c1-dc25-4239-8754-642b92a00258 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:46.955874 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e2d701c1-dc25-4239-8754-642b92a00258 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:46.990824 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2d701c1-dc25-4239-8754-642b92a00258 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:46.992918 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2d701c1-dc25-4239-8754-642b92a00258 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:47.001029 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2d701c1-dc25-4239-8754-642b92a00258 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:47.001909 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e2d701c1-dc25-4239-8754-642b92a00258 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:47.252981 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2d701c1-dc25-4239-8754-642b92a00258 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:47.267329 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2d701c1-dc25-4239-8754-642b92a00258 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:47.272130 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e2d701c1-dc25-4239-8754-642b92a00258 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:47.284356 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e2d701c1-dc25-4239-8754-642b92a00258 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.325460 Jul 20 11:42:47.284959 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 356/724] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:46 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:47.406520 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-87edf67e-e385-4f92-97b1-b5b9755ea763 req-445746a5-07a1-4ae5-ac89-e855f20461b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78cd1446-9e8f-4683-8f7f-1be9fff0bc94", "tag": "f6467344-0b58-4e3a-9d8a-0f4ddb0d4cb1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:47.422674 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-87edf67e-e385-4f92-97b1-b5b9755ea763 req-445746a5-07a1-4ae5-ac89-e855f20461b5 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:47.422674 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-87edf67e-e385-4f92-97b1-b5b9755ea763 req-445746a5-07a1-4ae5-ac89-e855f20461b5 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:47.447657 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-87edf67e-e385-4f92-97b1-b5b9755ea763 req-445746a5-07a1-4ae5-ac89-e855f20461b5 service nova] Creating event network-changed:f6467344-0b58-4e3a-9d8a-0f4ddb0d4cb1 for instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 on hv-cinder-82282 Jul 20 11:42:47.457718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-87edf67e-e385-4f92-97b1-b5b9755ea763 req-445746a5-07a1-4ae5-ac89-e855f20461b5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056085 Jul 20 11:42:47.458964 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 369/725] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:42:48.296575 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-82060fdc-8a3e-44da-aaf9-245279f69599 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:48.298909 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-82060fdc-8a3e-44da-aaf9-245279f69599 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:48.314029 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82060fdc-8a3e-44da-aaf9-245279f69599 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:48.316366 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82060fdc-8a3e-44da-aaf9-245279f69599 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:48.318075 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82060fdc-8a3e-44da-aaf9-245279f69599 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:48.320456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-82060fdc-8a3e-44da-aaf9-245279f69599 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:48.596045 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-82060fdc-8a3e-44da-aaf9-245279f69599 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:48.616606 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-82060fdc-8a3e-44da-aaf9-245279f69599 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:48.618715 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-82060fdc-8a3e-44da-aaf9-245279f69599 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:48.620118 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-82060fdc-8a3e-44da-aaf9-245279f69599 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.328984 Jul 20 11:42:48.621187 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 357/726] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:48 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:48.880057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bbcd6ac7-b7e8-4aef-b4ed-a73b8b7b75c7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:48.882326 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bbcd6ac7-b7e8-4aef-b4ed-a73b8b7b75c7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:48.892016 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbcd6ac7-b7e8-4aef-b4ed-a73b8b7b75c7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:48.897238 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbcd6ac7-b7e8-4aef-b4ed-a73b8b7b75c7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:48.899729 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbcd6ac7-b7e8-4aef-b4ed-a73b8b7b75c7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:48.901154 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bbcd6ac7-b7e8-4aef-b4ed-a73b8b7b75c7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:48.957180 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bbcd6ac7-b7e8-4aef-b4ed-a73b8b7b75c7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081/ips" status: 200 len: 149 microversion: 2.1 time: 0.318312 Jul 20 11:42:48.957740 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 370/727] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 11:42:48 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081/ips => generated 149 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:42:48.968880 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-487b9a3d-22f9-4721-ad66-4957815846ab tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "927bee44-78c9-4906-937e-fe819e93f82b"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:48.970095 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-487b9a3d-22f9-4721-ad66-4957815846ab tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:48.976922 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487b9a3d-22f9-4721-ad66-4957815846ab tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:48.977373 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487b9a3d-22f9-4721-ad66-4957815846ab tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:48.978145 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487b9a3d-22f9-4721-ad66-4957815846ab tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:48.978582 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487b9a3d-22f9-4721-ad66-4957815846ab tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:49.104202 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-487b9a3d-22f9-4721-ad66-4957815846ab tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Invalid volume: volume 927bee44-78c9-4906-937e-fe819e93f82b is already attached to instances: e19a7062-f17c-4693-9941-040c456d9bcf Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-487b9a3d-22f9-4721-ad66-4957815846ab tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: POST /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081/os-volume_attachments HTTP/1.1 Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 74 Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:42:49.112966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:42:49.114768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:42:49.114768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:42:49.114768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:42:49.114768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:42:49.114768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:42:49.114768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:42:49.114768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:42:49.114768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:42:49.114768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:42:49.114768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Jul 20 11:42:49.114768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {"volumeAttachment": {"volumeId": "927bee44-78c9-4906-937e-fe819e93f82b"}} Jul 20 11:42:49.114768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Invalid volume: volume 927bee44-78c9-4906-937e-fe819e93f82b is already attached to instances: e19a7062-f17c-4693-9941-040c456d9bcf Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'server_id': 'fd4c8483-4de8-465a-8214-90e2f2b77081', 'body': {'volumeAttachment': {'volumeId': '927bee44-78c9-4906-937e-fe819e93f82b'}}} Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 927bee44-78c9-4906-937e-fe819e93f82b is already attached to instances: e19a7062-f17c-4693-9941-040c456d9bcf Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:42:49.115867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 927bee44-78c9-4906-937e-fe819e93f82b is already attached to instances: e19a7062-f17c-4693-9941-040c456d9bcf Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:42:49.117477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:42:49.119430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:42:49.119430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:42:49.119430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:42:49.119430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 927bee44-78c9-4906-937e-fe819e93f82b is already attached to instances: e19a7062-f17c-4693-9941-040c456d9bcf Jul 20 11:42:49.119430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:42:49.119430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-487b9a3d-22f9-4721-ad66-4957815846ab tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 400 to user: Invalid volume: volume 927bee44-78c9-4906-937e-fe819e93f82b is already attached to instances: e19a7062-f17c-4693-9941-040c456d9bcf {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:42:49.119430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-487b9a3d-22f9-4721-ad66-4957815846ab tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "POST /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.152463 Jul 20 11:42:49.119915 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 358/728] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:42:48 2022] POST /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081/os-volume_attachments => generated 174 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:42:49.128882 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-60f2f26e-30d7-4bbe-a269-5d35ddb44d17 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:49.129580 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-60f2f26e-30d7-4bbe-a269-5d35ddb44d17 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:49.145863 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60f2f26e-30d7-4bbe-a269-5d35ddb44d17 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:49.151984 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60f2f26e-30d7-4bbe-a269-5d35ddb44d17 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:49.152768 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60f2f26e-30d7-4bbe-a269-5d35ddb44d17 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:49.153241 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-60f2f26e-30d7-4bbe-a269-5d35ddb44d17 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:49.215680 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-60f2f26e-30d7-4bbe-a269-5d35ddb44d17 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:42:49.475718 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-ae9f3859-7d3a-45ca-8128-7026b1224bb2 req-bb61fa82-1c6e-425c-aac5-cae02d1fb63a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78cd1446-9e8f-4683-8f7f-1be9fff0bc94", "tag": "f6467344-0b58-4e3a-9d8a-0f4ddb0d4cb1"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:49.487277 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-ae9f3859-7d3a-45ca-8128-7026b1224bb2 req-bb61fa82-1c6e-425c-aac5-cae02d1fb63a service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:49.487724 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-ae9f3859-7d3a-45ca-8128-7026b1224bb2 req-bb61fa82-1c6e-425c-aac5-cae02d1fb63a service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:49.499627 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-ae9f3859-7d3a-45ca-8128-7026b1224bb2 req-bb61fa82-1c6e-425c-aac5-cae02d1fb63a service nova] Creating event network-changed:f6467344-0b58-4e3a-9d8a-0f4ddb0d4cb1 for instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 on hv-cinder-82282 Jul 20 11:42:49.504946 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-ae9f3859-7d3a-45ca-8128-7026b1224bb2 req-bb61fa82-1c6e-425c-aac5-cae02d1fb63a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032934 Jul 20 11:42:49.505679 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 359/729] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:42:49.594368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-60f2f26e-30d7-4bbe-a269-5d35ddb44d17 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 204 len: 0 microversion: 2.1 time: 0.466727 Jul 20 11:42:49.594368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 371/730] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:42:49 2022] DELETE /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:42:49.600715 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-594cb7c6-f806-4601-a140-f20c80471b0e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:49.601571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-594cb7c6-f806-4601-a140-f20c80471b0e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:49.611651 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-594cb7c6-f806-4601-a140-f20c80471b0e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:49.612219 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-594cb7c6-f806-4601-a140-f20c80471b0e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:49.616559 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-594cb7c6-f806-4601-a140-f20c80471b0e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:49.617198 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-594cb7c6-f806-4601-a140-f20c80471b0e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:49.643624 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c8f87efe-e887-4161-9c40-fd5655c0a809 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:49.644448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c8f87efe-e887-4161-9c40-fd5655c0a809 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:49.656940 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8f87efe-e887-4161-9c40-fd5655c0a809 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:49.657580 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8f87efe-e887-4161-9c40-fd5655c0a809 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:49.659806 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8f87efe-e887-4161-9c40-fd5655c0a809 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:49.660331 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8f87efe-e887-4161-9c40-fd5655c0a809 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:49.872432 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-594cb7c6-f806-4601-a140-f20c80471b0e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:49.890433 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-594cb7c6-f806-4601-a140-f20c80471b0e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1680 microversion: 2.1 time: 0.293858 Jul 20 11:42:49.894791 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 360/731] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:49 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1680 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:49.942733 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c8f87efe-e887-4161-9c40-fd5655c0a809 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:49.951865 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c8f87efe-e887-4161-9c40-fd5655c0a809 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:49.953473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c8f87efe-e887-4161-9c40-fd5655c0a809 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:49.954682 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c8f87efe-e887-4161-9c40-fd5655c0a809 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.318085 Jul 20 11:42:49.955313 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 372/732] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:49 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:50.910215 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b79ff619-be86-4af4-ae94-a00e73dbe27c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:50.910838 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b79ff619-be86-4af4-ae94-a00e73dbe27c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:50.917343 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b79ff619-be86-4af4-ae94-a00e73dbe27c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:50.917794 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b79ff619-be86-4af4-ae94-a00e73dbe27c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:50.918547 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b79ff619-be86-4af4-ae94-a00e73dbe27c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:50.918979 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b79ff619-be86-4af4-ae94-a00e73dbe27c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:50.974583 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5e11bf18-204a-4ff1-9b32-510946e4c00d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:50.975235 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5e11bf18-204a-4ff1-9b32-510946e4c00d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:50.981947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e11bf18-204a-4ff1-9b32-510946e4c00d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:50.982746 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e11bf18-204a-4ff1-9b32-510946e4c00d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:50.983889 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e11bf18-204a-4ff1-9b32-510946e4c00d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:50.984543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e11bf18-204a-4ff1-9b32-510946e4c00d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:51.132502 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b79ff619-be86-4af4-ae94-a00e73dbe27c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:51.143379 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b79ff619-be86-4af4-ae94-a00e73dbe27c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1680 microversion: 2.1 time: 0.236908 Jul 20 11:42:51.144068 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 361/733] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:50 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:51.179205 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e11bf18-204a-4ff1-9b32-510946e4c00d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:51.190122 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e11bf18-204a-4ff1-9b32-510946e4c00d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:51.191949 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e11bf18-204a-4ff1-9b32-510946e4c00d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:51.193597 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5e11bf18-204a-4ff1-9b32-510946e4c00d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.223076 Jul 20 11:42:51.194406 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 373/734] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:50 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:42:52.161850 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3b9652b9-c4b4-4956-a2e7-34b098c3cda0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:52.162605 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3b9652b9-c4b4-4956-a2e7-34b098c3cda0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:52.169455 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b9652b9-c4b4-4956-a2e7-34b098c3cda0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:52.170335 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b9652b9-c4b4-4956-a2e7-34b098c3cda0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:52.171206 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b9652b9-c4b4-4956-a2e7-34b098c3cda0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:52.171986 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b9652b9-c4b4-4956-a2e7-34b098c3cda0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:52.213493 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1f1be023-9677-41e6-a326-ba2d1a00f779 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:52.214767 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1f1be023-9677-41e6-a326-ba2d1a00f779 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:52.221934 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f1be023-9677-41e6-a326-ba2d1a00f779 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:52.222649 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f1be023-9677-41e6-a326-ba2d1a00f779 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:52.223609 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f1be023-9677-41e6-a326-ba2d1a00f779 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:52.224239 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1f1be023-9677-41e6-a326-ba2d1a00f779 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:52.446320 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3b9652b9-c4b4-4956-a2e7-34b098c3cda0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:52.449800 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f1be023-9677-41e6-a326-ba2d1a00f779 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:52.458336 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3b9652b9-c4b4-4956-a2e7-34b098c3cda0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1680 microversion: 2.1 time: 0.300966 Jul 20 11:42:52.459293 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 362/735] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:52 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1680 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:52.460314 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f1be023-9677-41e6-a326-ba2d1a00f779 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:52.461904 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1f1be023-9677-41e6-a326-ba2d1a00f779 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:52.463098 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1f1be023-9677-41e6-a326-ba2d1a00f779 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.253465 Jul 20 11:42:52.476516 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 374/736] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:52 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:42:53.475993 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1187768b-0d1c-4b45-bb9c-39f3ed425a11 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:53.476670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1187768b-0d1c-4b45-bb9c-39f3ed425a11 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:53.481536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a971b1fd-ec81-416f-adbe-1afeb5fe7455 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:53.482179 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a971b1fd-ec81-416f-adbe-1afeb5fe7455 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:53.484037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1187768b-0d1c-4b45-bb9c-39f3ed425a11 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:53.484480 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1187768b-0d1c-4b45-bb9c-39f3ed425a11 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:53.485269 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1187768b-0d1c-4b45-bb9c-39f3ed425a11 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:53.485697 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1187768b-0d1c-4b45-bb9c-39f3ed425a11 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:53.489244 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a971b1fd-ec81-416f-adbe-1afeb5fe7455 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:53.489761 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a971b1fd-ec81-416f-adbe-1afeb5fe7455 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:53.490642 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a971b1fd-ec81-416f-adbe-1afeb5fe7455 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:53.491103 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a971b1fd-ec81-416f-adbe-1afeb5fe7455 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:54.000305 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1187768b-0d1c-4b45-bb9c-39f3ed425a11 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:54.008641 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1187768b-0d1c-4b45-bb9c-39f3ed425a11 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1680 microversion: 2.1 time: 0.536355 Jul 20 11:42:54.013733 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 363/737] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:53 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1680 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:54.059288 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a971b1fd-ec81-416f-adbe-1afeb5fe7455 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:54.068496 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a971b1fd-ec81-416f-adbe-1afeb5fe7455 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:54.070331 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a971b1fd-ec81-416f-adbe-1afeb5fe7455 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:54.075824 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a971b1fd-ec81-416f-adbe-1afeb5fe7455 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.598047 Jul 20 11:42:54.076438 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 375/738] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:53 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:55.031378 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-94507af5-b638-4317-aa19-0f5edbcd3a33 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:55.032235 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-94507af5-b638-4317-aa19-0f5edbcd3a33 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:55.039787 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94507af5-b638-4317-aa19-0f5edbcd3a33 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:55.040467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94507af5-b638-4317-aa19-0f5edbcd3a33 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:55.041626 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94507af5-b638-4317-aa19-0f5edbcd3a33 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:55.042164 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-94507af5-b638-4317-aa19-0f5edbcd3a33 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:55.052859 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:55.198172 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-94507af5-b638-4317-aa19-0f5edbcd3a33 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:55.207607 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-94507af5-b638-4317-aa19-0f5edbcd3a33 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1680 microversion: 2.1 time: 0.180062 Jul 20 11:42:55.208204 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 364/739] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:55 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:55.223289 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9a79bf72-54cf-4378-88d5-ee341fe47c0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:55.223901 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9a79bf72-54cf-4378-88d5-ee341fe47c0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:55.230090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a79bf72-54cf-4378-88d5-ee341fe47c0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:55.230548 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a79bf72-54cf-4378-88d5-ee341fe47c0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:55.231323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a79bf72-54cf-4378-88d5-ee341fe47c0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:55.231943 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a79bf72-54cf-4378-88d5-ee341fe47c0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:55.372400 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9a79bf72-54cf-4378-88d5-ee341fe47c0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:55.381293 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9a79bf72-54cf-4378-88d5-ee341fe47c0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:55.382875 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9a79bf72-54cf-4378-88d5-ee341fe47c0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:55.384077 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9a79bf72-54cf-4378-88d5-ee341fe47c0e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.292496 Jul 20 11:42:55.384636 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 376/740] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:55 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:42:56.225984 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-59a9b869-df6e-451c-948f-06d19251282a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:56.226600 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-59a9b869-df6e-451c-948f-06d19251282a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:56.233222 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59a9b869-df6e-451c-948f-06d19251282a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:56.234170 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59a9b869-df6e-451c-948f-06d19251282a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:56.234948 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59a9b869-df6e-451c-948f-06d19251282a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:56.235373 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59a9b869-df6e-451c-948f-06d19251282a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:56.377999 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59a9b869-df6e-451c-948f-06d19251282a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:56.385866 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-59a9b869-df6e-451c-948f-06d19251282a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1680 microversion: 2.1 time: 0.164087 Jul 20 11:42:56.386444 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 365/741] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:56 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:56.403144 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c0648ac6-91df-4cbb-91d6-9f1a89749cb3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:56.403762 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c0648ac6-91df-4cbb-91d6-9f1a89749cb3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:56.406343 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:56.411242 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0648ac6-91df-4cbb-91d6-9f1a89749cb3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:56.411702 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0648ac6-91df-4cbb-91d6-9f1a89749cb3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:56.412458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0648ac6-91df-4cbb-91d6-9f1a89749cb3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:56.412933 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c0648ac6-91df-4cbb-91d6-9f1a89749cb3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:56.554815 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c0648ac6-91df-4cbb-91d6-9f1a89749cb3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:56.567404 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c0648ac6-91df-4cbb-91d6-9f1a89749cb3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:56.569132 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c0648ac6-91df-4cbb-91d6-9f1a89749cb3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:56.570329 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c0648ac6-91df-4cbb-91d6-9f1a89749cb3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.171167 Jul 20 11:42:56.570895 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 377/742] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:56 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:57.403238 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c2facf54-4625-4502-9aea-8f177e355060 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:57.403944 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c2facf54-4625-4502-9aea-8f177e355060 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:57.411145 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2facf54-4625-4502-9aea-8f177e355060 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:57.411597 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2facf54-4625-4502-9aea-8f177e355060 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:57.412403 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2facf54-4625-4502-9aea-8f177e355060 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:57.412856 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2facf54-4625-4502-9aea-8f177e355060 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:57.550661 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c2facf54-4625-4502-9aea-8f177e355060 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:57.558995 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c2facf54-4625-4502-9aea-8f177e355060 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1680 microversion: 2.1 time: 0.159579 Jul 20 11:42:57.559573 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 366/743] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:57 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:57.589685 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5e62de6c-8724-40dc-8d7c-62fa2ea3fa2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:57.590299 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5e62de6c-8724-40dc-8d7c-62fa2ea3fa2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:57.597674 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e62de6c-8724-40dc-8d7c-62fa2ea3fa2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:57.598274 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e62de6c-8724-40dc-8d7c-62fa2ea3fa2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:57.599097 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e62de6c-8724-40dc-8d7c-62fa2ea3fa2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:57.599538 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e62de6c-8724-40dc-8d7c-62fa2ea3fa2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:57.734831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e62de6c-8724-40dc-8d7c-62fa2ea3fa2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:57.743408 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e62de6c-8724-40dc-8d7c-62fa2ea3fa2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:57.744967 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e62de6c-8724-40dc-8d7c-62fa2ea3fa2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:57.746380 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5e62de6c-8724-40dc-8d7c-62fa2ea3fa2d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.160573 Jul 20 11:42:57.746955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 378/744] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:57 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:58.576485 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-04fbb687-0dc6-4406-bdeb-bb55bb663fd2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:58.578746 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-04fbb687-0dc6-4406-bdeb-bb55bb663fd2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:58.585445 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04fbb687-0dc6-4406-bdeb-bb55bb663fd2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:58.585885 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04fbb687-0dc6-4406-bdeb-bb55bb663fd2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:58.586738 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04fbb687-0dc6-4406-bdeb-bb55bb663fd2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:58.587239 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-04fbb687-0dc6-4406-bdeb-bb55bb663fd2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:58.731063 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-04fbb687-0dc6-4406-bdeb-bb55bb663fd2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:58.739269 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-04fbb687-0dc6-4406-bdeb-bb55bb663fd2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1680 microversion: 2.1 time: 0.167469 Jul 20 11:42:58.739816 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 367/745] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:58 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:58.784759 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cf4088bd-7390-4b81-be8c-11fd41f04b20 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:58.785389 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cf4088bd-7390-4b81-be8c-11fd41f04b20 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:58.793197 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf4088bd-7390-4b81-be8c-11fd41f04b20 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:58.794827 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf4088bd-7390-4b81-be8c-11fd41f04b20 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:58.794827 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf4088bd-7390-4b81-be8c-11fd41f04b20 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:58.794827 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cf4088bd-7390-4b81-be8c-11fd41f04b20 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:58.925433 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf4088bd-7390-4b81-be8c-11fd41f04b20 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:58.933937 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf4088bd-7390-4b81-be8c-11fd41f04b20 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:58.935507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cf4088bd-7390-4b81-be8c-11fd41f04b20 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:58.936661 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cf4088bd-7390-4b81-be8c-11fd41f04b20 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.156362 Jul 20 11:42:58.937711 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 379/746] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:58 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:42:59.757061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8d6556f6-dd7c-4e64-bc67-40792999e55b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:59.757662 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8d6556f6-dd7c-4e64-bc67-40792999e55b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:59.764522 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d6556f6-dd7c-4e64-bc67-40792999e55b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:59.765000 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d6556f6-dd7c-4e64-bc67-40792999e55b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:59.766446 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d6556f6-dd7c-4e64-bc67-40792999e55b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:59.766880 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d6556f6-dd7c-4e64-bc67-40792999e55b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:59.899494 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8d6556f6-dd7c-4e64-bc67-40792999e55b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:59.906976 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8d6556f6-dd7c-4e64-bc67-40792999e55b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1680 microversion: 2.1 time: 0.153865 Jul 20 11:42:59.907542 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 368/747] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:59 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:59.955392 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e1d1e2a0-b5c5-4b90-87f4-3c8be7952c9f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:59.956000 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e1d1e2a0-b5c5-4b90-87f4-3c8be7952c9f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:59.962499 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1d1e2a0-b5c5-4b90-87f4-3c8be7952c9f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:59.962955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1d1e2a0-b5c5-4b90-87f4-3c8be7952c9f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:59.963715 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1d1e2a0-b5c5-4b90-87f4-3c8be7952c9f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:59.964152 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e1d1e2a0-b5c5-4b90-87f4-3c8be7952c9f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:00.099379 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1d1e2a0-b5c5-4b90-87f4-3c8be7952c9f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:00.108246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1d1e2a0-b5c5-4b90-87f4-3c8be7952c9f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:00.110548 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e1d1e2a0-b5c5-4b90-87f4-3c8be7952c9f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:00.111770 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e1d1e2a0-b5c5-4b90-87f4-3c8be7952c9f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.160276 Jul 20 11:43:00.112403 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 380/748] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:42:59 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:00.940066 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b588bead-7b94-4c3c-a051-7c2cf80b2c02 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:00.940066 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b588bead-7b94-4c3c-a051-7c2cf80b2c02 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:00.940066 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b588bead-7b94-4c3c-a051-7c2cf80b2c02 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:00.940066 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b588bead-7b94-4c3c-a051-7c2cf80b2c02 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:00.940965 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b588bead-7b94-4c3c-a051-7c2cf80b2c02 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:00.940965 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b588bead-7b94-4c3c-a051-7c2cf80b2c02 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:01.067513 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b588bead-7b94-4c3c-a051-7c2cf80b2c02 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:01.074867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b588bead-7b94-4c3c-a051-7c2cf80b2c02 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1680 microversion: 2.1 time: 0.152876 Jul 20 11:43:01.075433 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 369/749] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:00 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:01.130442 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b9eaeebe-02e7-4d3d-8fc0-ab5b3f926f2e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:01.131058 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b9eaeebe-02e7-4d3d-8fc0-ab5b3f926f2e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:01.137471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9eaeebe-02e7-4d3d-8fc0-ab5b3f926f2e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:01.137906 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9eaeebe-02e7-4d3d-8fc0-ab5b3f926f2e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:01.138675 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9eaeebe-02e7-4d3d-8fc0-ab5b3f926f2e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:01.139136 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9eaeebe-02e7-4d3d-8fc0-ab5b3f926f2e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:01.143576 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:01.279597 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b9eaeebe-02e7-4d3d-8fc0-ab5b3f926f2e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:01.289723 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b9eaeebe-02e7-4d3d-8fc0-ab5b3f926f2e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:01.292054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b9eaeebe-02e7-4d3d-8fc0-ab5b3f926f2e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:01.294007 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b9eaeebe-02e7-4d3d-8fc0-ab5b3f926f2e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.167648 Jul 20 11:43:01.294572 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 381/750] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:01 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:02.092390 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-97a26088-5ae1-457c-bc0c-b1757b6ad6df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:02.093018 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-97a26088-5ae1-457c-bc0c-b1757b6ad6df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:02.100020 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97a26088-5ae1-457c-bc0c-b1757b6ad6df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:02.100462 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97a26088-5ae1-457c-bc0c-b1757b6ad6df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:02.101244 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97a26088-5ae1-457c-bc0c-b1757b6ad6df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:02.101673 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97a26088-5ae1-457c-bc0c-b1757b6ad6df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:02.243647 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-97a26088-5ae1-457c-bc0c-b1757b6ad6df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:02.256824 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-97a26088-5ae1-457c-bc0c-b1757b6ad6df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1680 microversion: 2.1 time: 0.168053 Jul 20 11:43:02.257431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 370/751] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:02 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:02.311338 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d97b62c-5dbb-4c38-a42d-3d375deb298e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:02.311928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d97b62c-5dbb-4c38-a42d-3d375deb298e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:02.318482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d97b62c-5dbb-4c38-a42d-3d375deb298e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:02.318918 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d97b62c-5dbb-4c38-a42d-3d375deb298e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:02.319670 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d97b62c-5dbb-4c38-a42d-3d375deb298e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:02.320098 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d97b62c-5dbb-4c38-a42d-3d375deb298e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:02.449777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d97b62c-5dbb-4c38-a42d-3d375deb298e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:02.458813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d97b62c-5dbb-4c38-a42d-3d375deb298e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:02.460357 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d97b62c-5dbb-4c38-a42d-3d375deb298e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:02.461550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3d97b62c-5dbb-4c38-a42d-3d375deb298e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.154081 Jul 20 11:43:02.462114 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 382/752] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:02 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:03.279582 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8d96c4b8-e036-4f47-900a-f1ccec836608 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:03.280210 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8d96c4b8-e036-4f47-900a-f1ccec836608 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:03.287542 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d96c4b8-e036-4f47-900a-f1ccec836608 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:03.287995 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d96c4b8-e036-4f47-900a-f1ccec836608 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:03.288774 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d96c4b8-e036-4f47-900a-f1ccec836608 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:03.289242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8d96c4b8-e036-4f47-900a-f1ccec836608 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:03.428257 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8d96c4b8-e036-4f47-900a-f1ccec836608 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:03.436361 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8d96c4b8-e036-4f47-900a-f1ccec836608 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1680 microversion: 2.1 time: 0.160724 Jul 20 11:43:03.436953 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 371/753] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:03 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:03.480377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8ed7f648-095b-4c58-9c33-0a7fd5d05d63 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:03.481094 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8ed7f648-095b-4c58-9c33-0a7fd5d05d63 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:03.484119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:03.489613 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ed7f648-095b-4c58-9c33-0a7fd5d05d63 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:03.490138 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ed7f648-095b-4c58-9c33-0a7fd5d05d63 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:03.490850 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ed7f648-095b-4c58-9c33-0a7fd5d05d63 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:03.491319 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8ed7f648-095b-4c58-9c33-0a7fd5d05d63 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:03.642143 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8ed7f648-095b-4c58-9c33-0a7fd5d05d63 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:03.642143 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8ed7f648-095b-4c58-9c33-0a7fd5d05d63 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:03.642448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8ed7f648-095b-4c58-9c33-0a7fd5d05d63 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:03.642448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8ed7f648-095b-4c58-9c33-0a7fd5d05d63 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.158911 Jul 20 11:43:03.642448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 383/754] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:03 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:04.453804 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5317e3a5-f653-431c-9865-3b38ecfde3c5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:04.454468 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5317e3a5-f653-431c-9865-3b38ecfde3c5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:04.461430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5317e3a5-f653-431c-9865-3b38ecfde3c5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:04.461870 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5317e3a5-f653-431c-9865-3b38ecfde3c5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:04.462638 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5317e3a5-f653-431c-9865-3b38ecfde3c5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:04.463059 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5317e3a5-f653-431c-9865-3b38ecfde3c5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:04.660193 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1c1b1132-5b85-4571-b35f-02550dd20a0d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:04.660823 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1c1b1132-5b85-4571-b35f-02550dd20a0d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:04.667774 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c1b1132-5b85-4571-b35f-02550dd20a0d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:04.668221 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c1b1132-5b85-4571-b35f-02550dd20a0d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:04.669241 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c1b1132-5b85-4571-b35f-02550dd20a0d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:04.669680 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c1b1132-5b85-4571-b35f-02550dd20a0d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:04.738726 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5317e3a5-f653-431c-9865-3b38ecfde3c5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:04.746975 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5317e3a5-f653-431c-9865-3b38ecfde3c5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1680 microversion: 2.1 time: 0.297065 Jul 20 11:43:04.748142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 372/755] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:04 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1680 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:04.881088 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1c1b1132-5b85-4571-b35f-02550dd20a0d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:04.891718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1c1b1132-5b85-4571-b35f-02550dd20a0d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:04.893306 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1c1b1132-5b85-4571-b35f-02550dd20a0d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:04.894690 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1c1b1132-5b85-4571-b35f-02550dd20a0d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.239675 Jul 20 11:43:04.895478 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 384/756] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:04 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:43:05.369266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-d626bc2d-e47d-4209-abed-be19b0dd74d8 req-eec723e6-dae6-42b6-92d8-f60a34817f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd4c8483-4de8-465a-8214-90e2f2b77081", "name": "network-vif-deleted", "tag": "9fb4e847-dc3d-4d4f-a6da-3e3b572e6708"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:05.382749 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-d626bc2d-e47d-4209-abed-be19b0dd74d8 req-eec723e6-dae6-42b6-92d8-f60a34817f23 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:05.383737 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-d626bc2d-e47d-4209-abed-be19b0dd74d8 req-eec723e6-dae6-42b6-92d8-f60a34817f23 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:05.399654 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-d626bc2d-e47d-4209-abed-be19b0dd74d8 req-eec723e6-dae6-42b6-92d8-f60a34817f23 service nova] Creating event network-vif-deleted:9fb4e847-dc3d-4d4f-a6da-3e3b572e6708 for instance fd4c8483-4de8-465a-8214-90e2f2b77081 on hv-cinder-82282 Jul 20 11:43:05.407228 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-d626bc2d-e47d-4209-abed-be19b0dd74d8 req-eec723e6-dae6-42b6-92d8-f60a34817f23 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108352 Jul 20 11:43:05.417431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 373/757] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:43:05.764837 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0dcd3c80-9ca9-4621-ba73-574cd8120155 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:05.765448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0dcd3c80-9ca9-4621-ba73-574cd8120155 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:05.774754 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dcd3c80-9ca9-4621-ba73-574cd8120155 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:05.775433 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dcd3c80-9ca9-4621-ba73-574cd8120155 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:05.781391 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dcd3c80-9ca9-4621-ba73-574cd8120155 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:05.781391 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dcd3c80-9ca9-4621-ba73-574cd8120155 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:05.810811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dcd3c80-9ca9-4621-ba73-574cd8120155 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:05.811255 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0dcd3c80-9ca9-4621-ba73-574cd8120155 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:05.811856 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-0dcd3c80-9ca9-4621-ba73-574cd8120155 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lazy-loading 'fault' on Instance uuid fd4c8483-4de8-465a-8214-90e2f2b77081 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:43:05.855762 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0dcd3c80-9ca9-4621-ba73-574cd8120155 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:05.867168 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0dcd3c80-9ca9-4621-ba73-574cd8120155 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 200 len: 1331 microversion: 2.1 time: 0.106132 Jul 20 11:43:05.867761 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 385/758] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:05 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:05.915557 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b31b27a3-e91c-4e4f-b413-1d5c0eddb581 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:05.916361 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b31b27a3-e91c-4e4f-b413-1d5c0eddb581 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:05.923208 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b31b27a3-e91c-4e4f-b413-1d5c0eddb581 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:05.923686 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b31b27a3-e91c-4e4f-b413-1d5c0eddb581 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:05.924475 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b31b27a3-e91c-4e4f-b413-1d5c0eddb581 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:05.924981 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b31b27a3-e91c-4e4f-b413-1d5c0eddb581 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:06.079740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b31b27a3-e91c-4e4f-b413-1d5c0eddb581 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:06.090284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b31b27a3-e91c-4e4f-b413-1d5c0eddb581 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:06.092513 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b31b27a3-e91c-4e4f-b413-1d5c0eddb581 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:06.093956 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b31b27a3-e91c-4e4f-b413-1d5c0eddb581 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.183584 Jul 20 11:43:06.095073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 374/759] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:05 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:06.885177 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-66af1270-578f-4a22-a6c1-8164e46ac700 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:06.885999 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-66af1270-578f-4a22-a6c1-8164e46ac700 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:06.893650 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66af1270-578f-4a22-a6c1-8164e46ac700 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:06.896737 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66af1270-578f-4a22-a6c1-8164e46ac700 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:06.896737 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66af1270-578f-4a22-a6c1-8164e46ac700 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:06.896737 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66af1270-578f-4a22-a6c1-8164e46ac700 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:06.909907 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-66af1270-578f-4a22-a6c1-8164e46ac700 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-66af1270-578f-4a22-a6c1-8164e46ac700 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 HTTP/1.1 Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:43:06.911543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:43:06.913216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:43:06.913216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:43:06.913216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:43:06.913216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:43:06.913216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:43:06.913216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:43:06.913216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:43:06.913216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:43:06.913216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:43:06.913216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:43:06.913216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:43:06.913216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'fd4c8483-4de8-465a-8214-90e2f2b77081'} Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:43:06.914201 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:43:06.915718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:06.917569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-66af1270-578f-4a22-a6c1-8164e46ac700 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 404 to user: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:43:06.917569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-66af1270-578f-4a22-a6c1-8164e46ac700 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 404 len: 111 microversion: 2.1 time: 0.031911 Jul 20 11:43:06.917569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 386/760] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:06 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:43:06.922420 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2bb9429d-bdd0-4a64-af20-a16151001e8b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '.version_select at 0x7f44e00fc280>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:07.000926 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2bb9429d-bdd0-4a64-af20-a16151001e8b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279161765" status: 202 len: 0 microversion: 2.1 time: 0.082173 Jul 20 11:43:07.001518 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 375/761] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jul 20 11:43:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279161765 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:43:07.113437 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fb22c131-f145-4f2a-816a-442e65b7262e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:07.114142 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fb22c131-f145-4f2a-816a-442e65b7262e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:07.120622 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb22c131-f145-4f2a-816a-442e65b7262e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:07.121103 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb22c131-f145-4f2a-816a-442e65b7262e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:07.121955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb22c131-f145-4f2a-816a-442e65b7262e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:07.122461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fb22c131-f145-4f2a-816a-442e65b7262e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:07.285735 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fb22c131-f145-4f2a-816a-442e65b7262e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:07.295744 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fb22c131-f145-4f2a-816a-442e65b7262e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:07.297632 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fb22c131-f145-4f2a-816a-442e65b7262e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:07.301965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fb22c131-f145-4f2a-816a-442e65b7262e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.189386 Jul 20 11:43:07.301965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 387/762] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:07 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:08.053853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d0fa9764-95b5-4947-91da-68489f0feec5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:08.054362 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d0fa9764-95b5-4947-91da-68489f0feec5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:08.056979 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:08.062401 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0fa9764-95b5-4947-91da-68489f0feec5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:08.062847 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0fa9764-95b5-4947-91da-68489f0feec5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:08.063618 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0fa9764-95b5-4947-91da-68489f0feec5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:08.064053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0fa9764-95b5-4947-91da-68489f0feec5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:08.144320 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-d0fa9764-95b5-4947-91da-68489f0feec5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lazy-loading 'services' on Instance uuid e19a7062-f17c-4693-9941-040c456d9bcf {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:43:08.317548 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8d073b39-ad1f-4c6e-ad53-bb6cb99bdf65 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:08.318185 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8d073b39-ad1f-4c6e-ad53-bb6cb99bdf65 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:08.324557 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d073b39-ad1f-4c6e-ad53-bb6cb99bdf65 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:08.325042 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d073b39-ad1f-4c6e-ad53-bb6cb99bdf65 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:08.325811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d073b39-ad1f-4c6e-ad53-bb6cb99bdf65 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:08.326253 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8d073b39-ad1f-4c6e-ad53-bb6cb99bdf65 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:08.355854 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d0fa9764-95b5-4947-91da-68489f0feec5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments/927bee44-78c9-4906-937e-fe819e93f82b" status: 202 len: 0 microversion: 2.1 time: 0.306225 Jul 20 11:43:08.356525 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 376/763] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 11:43:08 2022] DELETE /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments/927bee44-78c9-4906-937e-fe819e93f82b => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:43:08.365120 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9b126cdd-fed3-4772-96a1-88963b6188e8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:08.366126 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9b126cdd-fed3-4772-96a1-88963b6188e8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:08.372606 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b126cdd-fed3-4772-96a1-88963b6188e8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:08.373091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b126cdd-fed3-4772-96a1-88963b6188e8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:08.373863 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b126cdd-fed3-4772-96a1-88963b6188e8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:08.374295 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b126cdd-fed3-4772-96a1-88963b6188e8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:08.405016 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9b126cdd-fed3-4772-96a1-88963b6188e8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Jul 20 11:43:08.409651 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 377/764] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:43:08 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:43:08.456597 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8d073b39-ad1f-4c6e-ad53-bb6cb99bdf65 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:08.465150 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8d073b39-ad1f-4c6e-ad53-bb6cb99bdf65 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:08.466655 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8d073b39-ad1f-4c6e-ad53-bb6cb99bdf65 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:08.467822 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8d073b39-ad1f-4c6e-ad53-bb6cb99bdf65 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.154169 Jul 20 11:43:08.468378 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 388/765] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:08 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:43:09.417371 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b8ac5806-308f-4f99-84b2-0be7c933ea1f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:09.418285 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b8ac5806-308f-4f99-84b2-0be7c933ea1f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:09.425276 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8ac5806-308f-4f99-84b2-0be7c933ea1f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:09.425722 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8ac5806-308f-4f99-84b2-0be7c933ea1f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:09.426482 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8ac5806-308f-4f99-84b2-0be7c933ea1f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:09.426921 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8ac5806-308f-4f99-84b2-0be7c933ea1f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:09.454498 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b8ac5806-308f-4f99-84b2-0be7c933ea1f tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041101 Jul 20 11:43:09.455050 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 378/766] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:43:09 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:09.485293 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-51a891be-c8ad-4838-ad4c-eb2e7a2b82ec tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:09.485898 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-51a891be-c8ad-4838-ad4c-eb2e7a2b82ec tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:09.492693 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51a891be-c8ad-4838-ad4c-eb2e7a2b82ec tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:09.493174 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51a891be-c8ad-4838-ad4c-eb2e7a2b82ec tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:09.493988 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51a891be-c8ad-4838-ad4c-eb2e7a2b82ec tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:09.494428 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51a891be-c8ad-4838-ad4c-eb2e7a2b82ec tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:09.629325 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-51a891be-c8ad-4838-ad4c-eb2e7a2b82ec tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:09.637643 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-51a891be-c8ad-4838-ad4c-eb2e7a2b82ec tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:09.639167 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-51a891be-c8ad-4838-ad4c-eb2e7a2b82ec tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:09.640303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-51a891be-c8ad-4838-ad4c-eb2e7a2b82ec tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.159060 Jul 20 11:43:09.640883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 389/767] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:09 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:10.466075 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-58563d26-8b6b-4795-822f-4c2a884eeb82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:10.466989 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-58563d26-8b6b-4795-822f-4c2a884eeb82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:10.473442 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58563d26-8b6b-4795-822f-4c2a884eeb82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:10.473889 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58563d26-8b6b-4795-822f-4c2a884eeb82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:10.474643 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58563d26-8b6b-4795-822f-4c2a884eeb82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:10.475076 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-58563d26-8b6b-4795-822f-4c2a884eeb82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:10.503905 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-58563d26-8b6b-4795-822f-4c2a884eeb82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041140 Jul 20 11:43:10.504454 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 379/768] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:43:10 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:10.663269 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9953c567-baf0-4e27-890c-e8c7bddb1fdf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:10.664142 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9953c567-baf0-4e27-890c-e8c7bddb1fdf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:10.671115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9953c567-baf0-4e27-890c-e8c7bddb1fdf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:10.671786 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9953c567-baf0-4e27-890c-e8c7bddb1fdf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:10.672727 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9953c567-baf0-4e27-890c-e8c7bddb1fdf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:10.673431 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9953c567-baf0-4e27-890c-e8c7bddb1fdf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:10.801881 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9953c567-baf0-4e27-890c-e8c7bddb1fdf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:10.810082 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9953c567-baf0-4e27-890c-e8c7bddb1fdf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:10.811577 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9953c567-baf0-4e27-890c-e8c7bddb1fdf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:10.812717 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9953c567-baf0-4e27-890c-e8c7bddb1fdf tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.157056 Jul 20 11:43:10.813290 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 390/769] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:10 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:11.515591 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e77256cc-e209-4b96-8f95-59caedb6f550 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:11.516504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e77256cc-e209-4b96-8f95-59caedb6f550 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:11.523836 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e77256cc-e209-4b96-8f95-59caedb6f550 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:11.524284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e77256cc-e209-4b96-8f95-59caedb6f550 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:11.525080 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e77256cc-e209-4b96-8f95-59caedb6f550 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:11.525515 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e77256cc-e209-4b96-8f95-59caedb6f550 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:11.553305 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e77256cc-e209-4b96-8f95-59caedb6f550 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041673 Jul 20 11:43:11.553854 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 380/770] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:43:11 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:11.830291 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-39c07f00-c6a5-45dc-844b-9c3df39d6b9a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:11.830811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-39c07f00-c6a5-45dc-844b-9c3df39d6b9a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:11.837534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39c07f00-c6a5-45dc-844b-9c3df39d6b9a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:11.838131 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39c07f00-c6a5-45dc-844b-9c3df39d6b9a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:11.838888 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39c07f00-c6a5-45dc-844b-9c3df39d6b9a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:11.839320 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-39c07f00-c6a5-45dc-844b-9c3df39d6b9a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:11.971125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39c07f00-c6a5-45dc-844b-9c3df39d6b9a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:11.979348 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39c07f00-c6a5-45dc-844b-9c3df39d6b9a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:11.980858 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-39c07f00-c6a5-45dc-844b-9c3df39d6b9a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:11.981997 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-39c07f00-c6a5-45dc-844b-9c3df39d6b9a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.155657 Jul 20 11:43:11.982621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 391/771] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:11 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:12.564952 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3e909aa3-9a83-4f3d-ad73-2e88f74f2613 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:12.565902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3e909aa3-9a83-4f3d-ad73-2e88f74f2613 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:12.572383 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e909aa3-9a83-4f3d-ad73-2e88f74f2613 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:12.572862 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e909aa3-9a83-4f3d-ad73-2e88f74f2613 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:12.573634 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e909aa3-9a83-4f3d-ad73-2e88f74f2613 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:12.574071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e909aa3-9a83-4f3d-ad73-2e88f74f2613 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:12.599228 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:12.603631 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3e909aa3-9a83-4f3d-ad73-2e88f74f2613 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042687 Jul 20 11:43:12.604185 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 381/772] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:43:12 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:13.001159 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e0ecc8c2-d418-4680-9e39-aa87c67c3696 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:13.001763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e0ecc8c2-d418-4680-9e39-aa87c67c3696 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:13.008705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0ecc8c2-d418-4680-9e39-aa87c67c3696 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:13.009181 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0ecc8c2-d418-4680-9e39-aa87c67c3696 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:13.009941 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0ecc8c2-d418-4680-9e39-aa87c67c3696 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:13.010373 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0ecc8c2-d418-4680-9e39-aa87c67c3696 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:13.145053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e0ecc8c2-d418-4680-9e39-aa87c67c3696 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:13.154106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e0ecc8c2-d418-4680-9e39-aa87c67c3696 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:13.155624 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e0ecc8c2-d418-4680-9e39-aa87c67c3696 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:13.156772 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e0ecc8c2-d418-4680-9e39-aa87c67c3696 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.159803 Jul 20 11:43:13.157360 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 392/773] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:12 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:13.615824 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-960ac2ff-6c1f-4344-a9d3-a42316f2f4c0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:13.616735 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-960ac2ff-6c1f-4344-a9d3-a42316f2f4c0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:13.623760 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-960ac2ff-6c1f-4344-a9d3-a42316f2f4c0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:13.624206 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-960ac2ff-6c1f-4344-a9d3-a42316f2f4c0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:13.625006 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-960ac2ff-6c1f-4344-a9d3-a42316f2f4c0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:13.625439 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-960ac2ff-6c1f-4344-a9d3-a42316f2f4c0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:13.653026 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-960ac2ff-6c1f-4344-a9d3-a42316f2f4c0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041714 Jul 20 11:43:13.653568 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 382/774] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:43:13 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:43:13.709372 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-698938a9-bb8f-4bc6-b9e5-ceaee5e60665 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:13.710223 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-698938a9-bb8f-4bc6-b9e5-ceaee5e60665 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:13.717297 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-698938a9-bb8f-4bc6-b9e5-ceaee5e60665 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:13.717739 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-698938a9-bb8f-4bc6-b9e5-ceaee5e60665 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:13.718494 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-698938a9-bb8f-4bc6-b9e5-ceaee5e60665 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:13.719017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-698938a9-bb8f-4bc6-b9e5-ceaee5e60665 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:13.748149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-698938a9-bb8f-4bc6-b9e5-ceaee5e60665 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:43:14.027989 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-698938a9-bb8f-4bc6-b9e5-ceaee5e60665 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 204 len: 0 microversion: 2.1 time: 0.322681 Jul 20 11:43:14.028650 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 393/775] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:43:13 2022] DELETE /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:43:14.037312 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d1f2831a-090f-4347-a1eb-d15bde956e6e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:14.037926 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d1f2831a-090f-4347-a1eb-d15bde956e6e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:14.044319 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1f2831a-090f-4347-a1eb-d15bde956e6e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:14.044760 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1f2831a-090f-4347-a1eb-d15bde956e6e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:14.045600 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1f2831a-090f-4347-a1eb-d15bde956e6e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:14.046030 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d1f2831a-090f-4347-a1eb-d15bde956e6e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:14.175755 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2b74105c-b1e7-419b-8d6d-3ee3a3c68fae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:14.175949 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d1f2831a-090f-4347-a1eb-d15bde956e6e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:14.176445 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2b74105c-b1e7-419b-8d6d-3ee3a3c68fae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:14.182433 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b74105c-b1e7-419b-8d6d-3ee3a3c68fae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:14.182873 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b74105c-b1e7-419b-8d6d-3ee3a3c68fae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:14.183378 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d1f2831a-090f-4347-a1eb-d15bde956e6e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1679 microversion: 2.1 time: 0.150570 Jul 20 11:43:14.183675 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b74105c-b1e7-419b-8d6d-3ee3a3c68fae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:14.183950 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 383/776] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:14 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:14.184120 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b74105c-b1e7-419b-8d6d-3ee3a3c68fae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:14.314996 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b74105c-b1e7-419b-8d6d-3ee3a3c68fae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:14.323166 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b74105c-b1e7-419b-8d6d-3ee3a3c68fae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:14.324645 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b74105c-b1e7-419b-8d6d-3ee3a3c68fae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:14.325804 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2b74105c-b1e7-419b-8d6d-3ee3a3c68fae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.154445 Jul 20 11:43:14.326358 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 394/777] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:14 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:43:15.200469 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-534f1757-49ca-4f2b-aaf9-0a3b65052282 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:15.201140 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-534f1757-49ca-4f2b-aaf9-0a3b65052282 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:15.207615 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-534f1757-49ca-4f2b-aaf9-0a3b65052282 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:15.209073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-534f1757-49ca-4f2b-aaf9-0a3b65052282 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:15.209411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-534f1757-49ca-4f2b-aaf9-0a3b65052282 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:15.209849 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-534f1757-49ca-4f2b-aaf9-0a3b65052282 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:15.346711 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-94a12123-5193-4f4b-825f-cb64374319a1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:15.347193 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-94a12123-5193-4f4b-825f-cb64374319a1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:15.353372 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94a12123-5193-4f4b-825f-cb64374319a1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:15.353814 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94a12123-5193-4f4b-825f-cb64374319a1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:15.354627 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94a12123-5193-4f4b-825f-cb64374319a1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:15.355062 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-94a12123-5193-4f4b-825f-cb64374319a1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:15.468126 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-534f1757-49ca-4f2b-aaf9-0a3b65052282 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:15.476953 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-534f1757-49ca-4f2b-aaf9-0a3b65052282 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1679 microversion: 2.1 time: 0.280203 Jul 20 11:43:15.477629 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 384/778] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:15 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1679 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:15.606327 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-94a12123-5193-4f4b-825f-cb64374319a1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:15.615537 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-94a12123-5193-4f4b-825f-cb64374319a1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:15.617070 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-94a12123-5193-4f4b-825f-cb64374319a1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:15.618226 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-94a12123-5193-4f4b-825f-cb64374319a1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.276429 Jul 20 11:43:15.618783 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 395/779] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:15 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:16.026763 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1261705382", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-443586517", "security_groups": [{"name": "tempest-secgroup-smoke-1035915013"}], "block_device_mapping_v2": [{"uuid": "5ff6fe89-81ac-4a9e-90ed-26592ea5f7b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6728c8a5-492f-4e81-8d8b-b2abdb951298"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:16.183579 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] validate_networks() for [('6728c8a5-492f-4e81-8d8b-b2abdb951298', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:43:16.318380 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-aaad13e2-5bff-4fe5-80dd-5d6774b44ece req-8fbb18d0-4a05-41bd-8d87-db96a438fc68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19a7062-f17c-4693-9941-040c456d9bcf", "name": "network-vif-deleted", "tag": "823be959-4c3b-4ce0-9838-c80d65b626cf"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:16.326699 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-aaad13e2-5bff-4fe5-80dd-5d6774b44ece req-8fbb18d0-4a05-41bd-8d87-db96a438fc68 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:16.327310 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-aaad13e2-5bff-4fe5-80dd-5d6774b44ece req-8fbb18d0-4a05-41bd-8d87-db96a438fc68 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:16.350800 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-aaad13e2-5bff-4fe5-80dd-5d6774b44ece req-8fbb18d0-4a05-41bd-8d87-db96a438fc68 service nova] Creating event network-vif-deleted:823be959-4c3b-4ce0-9838-c80d65b626cf for instance e19a7062-f17c-4693-9941-040c456d9bcf on hv-cinder-82282 Jul 20 11:43:16.356034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-aaad13e2-5bff-4fe5-80dd-5d6774b44ece req-8fbb18d0-4a05-41bd-8d87-db96a438fc68 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043179 Jul 20 11:43:16.357595 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 396/780] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:16.494891 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92c79acf-80ac-4dfc-b536-fb543bf37077 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:16.495593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-92c79acf-80ac-4dfc-b536-fb543bf37077 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:16.509543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c79acf-80ac-4dfc-b536-fb543bf37077 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:16.510051 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c79acf-80ac-4dfc-b536-fb543bf37077 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:16.510783 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c79acf-80ac-4dfc-b536-fb543bf37077 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:16.511218 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92c79acf-80ac-4dfc-b536-fb543bf37077 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:16.515987 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:16.620003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-92c79acf-80ac-4dfc-b536-fb543bf37077 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:16.629058 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-92c79acf-80ac-4dfc-b536-fb543bf37077 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1325 microversion: 2.1 time: 0.138239 Jul 20 11:43:16.640346 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 397/781] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:16 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1325 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:16.645559 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dd30e2bf-c9b7-4c83-a8ca-77f28ba8f328 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:16.646329 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dd30e2bf-c9b7-4c83-a8ca-77f28ba8f328 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:16.667025 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd30e2bf-c9b7-4c83-a8ca-77f28ba8f328 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:16.667573 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd30e2bf-c9b7-4c83-a8ca-77f28ba8f328 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:16.669184 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd30e2bf-c9b7-4c83-a8ca-77f28ba8f328 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:16.670953 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd30e2bf-c9b7-4c83-a8ca-77f28ba8f328 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:16.879446 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:43:16.882796 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:43:16.882993 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:43:16.883605 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:43:16.884246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:43:16.895348 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:16.896402 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:16.903156 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:16.904175 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:16.914010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dd30e2bf-c9b7-4c83-a8ca-77f28ba8f328 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:16.924434 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dd30e2bf-c9b7-4c83-a8ca-77f28ba8f328 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:16.926015 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dd30e2bf-c9b7-4c83-a8ca-77f28ba8f328 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:16.927816 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dd30e2bf-c9b7-4c83-a8ca-77f28ba8f328 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.286253 Jul 20 11:43:16.928378 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 398/782] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:16 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:16.932903 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Getting quotas for project fb6890ad12fa47eeb3cc29dbec41dbe2. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:43:16.933190 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-c3dfee4a-ee4b-46a0-85c4-e222a553e45d req-06beb0d4-e43c-4ddf-be37-2c2ac279d6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3abfd3-22be-4728-9006-19ad38c1bd9c", "name": "network-vif-plugged", "status": "completed", "tag": "e605e30c-d865-4978-9798-9dc53408552e"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:16.937437 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Getting quotas for user a32c5062f269416d9345c2ea2c6f85b6 and project fb6890ad12fa47eeb3cc29dbec41dbe2. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:43:16.941477 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c3dfee4a-ee4b-46a0-85c4-e222a553e45d req-06beb0d4-e43c-4ddf-be37-2c2ac279d6f9 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:16.941918 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-c3dfee4a-ee4b-46a0-85c4-e222a553e45d req-06beb0d4-e43c-4ddf-be37-2c2ac279d6f9 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:16.953765 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-c3dfee4a-ee4b-46a0-85c4-e222a553e45d req-06beb0d4-e43c-4ddf-be37-2c2ac279d6f9 service nova] Creating event network-vif-plugged:e605e30c-d865-4978-9798-9dc53408552e for instance ea3abfd3-22be-4728-9006-19ad38c1bd9c on hv-cinder-82282 Jul 20 11:43:16.959176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-c3dfee4a-ee4b-46a0-85c4-e222a553e45d req-06beb0d4-e43c-4ddf-be37-2c2ac279d6f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029492 Jul 20 11:43:16.959780 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 399/783] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:17.003253 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:43:17.005557 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ff6fe89-81ac-4a9e-90ed-26592ea5f7b2',volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:43:17.375699 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b81085e-a263-45f9-8b2f-eecfb7cb6b36 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.353097 Jul 20 11:43:17.376554 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 385/784] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:43:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:43:17.387795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d664d169-7916-48ff-9e59-dc78e21bfa84 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:17.393407 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d664d169-7916-48ff-9e59-dc78e21bfa84 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:17.446334 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d664d169-7916-48ff-9e59-dc78e21bfa84 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:17.453307 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d664d169-7916-48ff-9e59-dc78e21bfa84 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1094 microversion: 2.1 time: 0.070119 Jul 20 11:43:17.453950 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 400/785] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:17 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:17.647625 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8ee2a205-b21c-4954-8961-576905f29cb7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:17.648153 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8ee2a205-b21c-4954-8961-576905f29cb7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:17.654976 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ee2a205-b21c-4954-8961-576905f29cb7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:17.655463 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ee2a205-b21c-4954-8961-576905f29cb7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:17.658997 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ee2a205-b21c-4954-8961-576905f29cb7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:17.658997 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ee2a205-b21c-4954-8961-576905f29cb7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:17.686967 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ee2a205-b21c-4954-8961-576905f29cb7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:17.687440 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8ee2a205-b21c-4954-8961-576905f29cb7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:17.687894 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-8ee2a205-b21c-4954-8961-576905f29cb7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lazy-loading 'fault' on Instance uuid e19a7062-f17c-4693-9941-040c456d9bcf {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:43:17.730933 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8ee2a205-b21c-4954-8961-576905f29cb7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:17.737613 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8ee2a205-b21c-4954-8961-576905f29cb7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 200 len: 1330 microversion: 2.1 time: 0.094914 Jul 20 11:43:17.738189 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 386/786] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:17 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:17.945493 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-64455ed7-8892-42ae-be67-847e4010923b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:17.946102 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-64455ed7-8892-42ae-be67-847e4010923b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:17.952277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64455ed7-8892-42ae-be67-847e4010923b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:17.952723 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64455ed7-8892-42ae-be67-847e4010923b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:17.953519 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64455ed7-8892-42ae-be67-847e4010923b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:17.953952 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-64455ed7-8892-42ae-be67-847e4010923b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:18.088808 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-64455ed7-8892-42ae-be67-847e4010923b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:18.097132 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-64455ed7-8892-42ae-be67-847e4010923b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:18.099697 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-64455ed7-8892-42ae-be67-847e4010923b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:18.100330 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-64455ed7-8892-42ae-be67-847e4010923b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.158788 Jul 20 11:43:18.100905 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 401/787] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:17 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:18.471036 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d14bbe6c-b776-4caf-92f9-eb1163eef8bf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:18.471655 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d14bbe6c-b776-4caf-92f9-eb1163eef8bf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:18.478115 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d14bbe6c-b776-4caf-92f9-eb1163eef8bf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:18.478560 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d14bbe6c-b776-4caf-92f9-eb1163eef8bf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:18.479328 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d14bbe6c-b776-4caf-92f9-eb1163eef8bf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:18.479761 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d14bbe6c-b776-4caf-92f9-eb1163eef8bf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:18.540268 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d14bbe6c-b776-4caf-92f9-eb1163eef8bf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:18.547786 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d14bbe6c-b776-4caf-92f9-eb1163eef8bf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1144 microversion: 2.1 time: 0.080838 Jul 20 11:43:18.548348 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 387/788] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:18 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:18.762007 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c585091-f547-43f1-8004-aab0952a62b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:18.762615 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c585091-f547-43f1-8004-aab0952a62b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:18.769620 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c585091-f547-43f1-8004-aab0952a62b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:18.770061 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c585091-f547-43f1-8004-aab0952a62b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:18.771050 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c585091-f547-43f1-8004-aab0952a62b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:18.771511 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c585091-f547-43f1-8004-aab0952a62b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:18.786728 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-3c585091-f547-43f1-8004-aab0952a62b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c585091-f547-43f1-8004-aab0952a62b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf HTTP/1.1 Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:43:18.788369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:43:18.789795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:43:18.789795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:43:18.789795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:43:18.789795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:43:18.789795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:43:18.789795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:43:18.789795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:43:18.789795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:43:18.789795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:43:18.789795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:43:18.789795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:43:18.789795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'e19a7062-f17c-4693-9941-040c456d9bcf'} Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:43:18.791216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:43:18.792753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:18.794219 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c585091-f547-43f1-8004-aab0952a62b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 404 to user: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:43:18.794219 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3c585091-f547-43f1-8004-aab0952a62b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 404 len: 111 microversion: 2.1 time: 0.032113 Jul 20 11:43:18.794219 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 402/789] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:18 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:43:18.799387 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-67c05507-cbbf-4e60-917f-b8570e2e6a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '.version_select at 0x7f44e00349d0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:18.901073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-67c05507-cbbf-4e60-917f-b8570e2e6a1a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1681288528" status: 202 len: 0 microversion: 2.1 time: 0.105475 Jul 20 11:43:18.901666 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 388/790] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jul 20 11:43:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1681288528 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:43:19.119659 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-45f79900-a9f5-4d0b-88f3-7f34c3b38685 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:19.120562 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-45f79900-a9f5-4d0b-88f3-7f34c3b38685 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:19.136493 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45f79900-a9f5-4d0b-88f3-7f34c3b38685 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:19.137188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45f79900-a9f5-4d0b-88f3-7f34c3b38685 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:19.138158 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45f79900-a9f5-4d0b-88f3-7f34c3b38685 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:19.138784 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45f79900-a9f5-4d0b-88f3-7f34c3b38685 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:19.182957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5ae0f840-ff22-4dfb-bb11-32425c111c93 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1708906274"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:19.183503 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5ae0f840-ff22-4dfb-bb11-32425c111c93 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:19.189380 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ae0f840-ff22-4dfb-bb11-32425c111c93 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:19.190006 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ae0f840-ff22-4dfb-bb11-32425c111c93 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:19.190988 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ae0f840-ff22-4dfb-bb11-32425c111c93 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:19.191426 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5ae0f840-ff22-4dfb-bb11-32425c111c93 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:19.726859 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45f79900-a9f5-4d0b-88f3-7f34c3b38685 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:19.736106 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45f79900-a9f5-4d0b-88f3-7f34c3b38685 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:19.739224 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45f79900-a9f5-4d0b-88f3-7f34c3b38685 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:19.739224 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-45f79900-a9f5-4d0b-88f3-7f34c3b38685 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.624754 Jul 20 11:43:19.745190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 389/791] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:19 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:43:19.745367 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.network.security_group_api [None req-5ae0f840-ff22-4dfb-bb11-32425c111c93 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Removing security group 6757820c-4a73-420b-b02f-2e68eff9422d from port 7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe Jul 20 11:43:19.745475 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7e3838b3-e751-4709-bb34-dffc99662c51 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:19.745475 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7e3838b3-e751-4709-bb34-dffc99662c51 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:19.751460 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e3838b3-e751-4709-bb34-dffc99662c51 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:19.752075 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e3838b3-e751-4709-bb34-dffc99662c51 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:19.753042 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e3838b3-e751-4709-bb34-dffc99662c51 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:19.753571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7e3838b3-e751-4709-bb34-dffc99662c51 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:19.851136 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7e3838b3-e751-4709-bb34-dffc99662c51 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:19.858602 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7e3838b3-e751-4709-bb34-dffc99662c51 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1136 microversion: 2.1 time: 0.117710 Jul 20 11:43:19.859168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 390/792] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:19 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1136 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:20.345117 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ed8b1077-5a0b-46a6-afc3-0da05c314c9a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Action: 'create', calling method: .version_select at 0x7f44e00a1550>, body: {"keypair": {"name": "tempest-keypair-187577268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuRd6B9ytK0n4oEOkKjUjLNfGyYuc3EMo5o8q86dmP3TpKcXxy5pd+vsg/ttoN+64BXjjrjuPNOBN4hpjDEFmhHsWyJeRTJSx8TeJBDyF0e3Vg6KEqdnU7JPcVxZ8TjnQ=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:20.359114 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-ed8b1077-5a0b-46a6-afc3-0da05c314c9a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for project d4fa73c956fe44a59272f727320743e0. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:43:20.362852 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-ed8b1077-5a0b-46a6-afc3-0da05c314c9a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for user 54c7d577e64f48cab8c331ff192be0a6 and project d4fa73c956fe44a59272f727320743e0. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:43:20.447165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5ae0f840-ff22-4dfb-bb11-32425c111c93 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "POST /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/action" status: 202 len: 0 microversion: 2.1 time: 1.407660 Jul 20 11:43:20.447165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 403/793] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:43:19 2022] POST /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/action => generated 0 bytes in 1409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:43:20.466330 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-ff742109-e706-483a-8901-4ef7a8334469 req-2a71238b-ef11-4ae5-b126-8fcad30a355a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ace499-ddc8-4a47-8e3d-730594d57bfa", "tag": "7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:20.479161 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-ff742109-e706-483a-8901-4ef7a8334469 req-2a71238b-ef11-4ae5-b126-8fcad30a355a service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:20.479613 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-ff742109-e706-483a-8901-4ef7a8334469 req-2a71238b-ef11-4ae5-b126-8fcad30a355a service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:20.484550 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ed8b1077-5a0b-46a6-afc3-0da05c314c9a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.140450 Jul 20 11:43:20.484550 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 391/794] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 11:43:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:43:20.500317 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-ff742109-e706-483a-8901-4ef7a8334469 req-2a71238b-ef11-4ae5-b126-8fcad30a355a service nova] Creating event network-changed:7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe for instance d0ace499-ddc8-4a47-8e3d-730594d57bfa on hv-cinder-82282 Jul 20 11:43:20.505878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-ff742109-e706-483a-8901-4ef7a8334469 req-2a71238b-ef11-4ae5-b126-8fcad30a355a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043065 Jul 20 11:43:20.507660 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 404/795] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:43:20.757770 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f6b26bf6-193b-47c2-87c6-747f27cca0f2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:20.758380 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f6b26bf6-193b-47c2-87c6-747f27cca0f2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:20.769945 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6b26bf6-193b-47c2-87c6-747f27cca0f2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:20.771036 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6b26bf6-193b-47c2-87c6-747f27cca0f2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:20.773757 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6b26bf6-193b-47c2-87c6-747f27cca0f2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:20.774435 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6b26bf6-193b-47c2-87c6-747f27cca0f2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:20.876732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a9a57533-ff65-421a-9576-e7f7f8930a9a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:20.877832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a9a57533-ff65-421a-9576-e7f7f8930a9a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:20.891102 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9a57533-ff65-421a-9576-e7f7f8930a9a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:20.892959 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9a57533-ff65-421a-9576-e7f7f8930a9a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:20.892959 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9a57533-ff65-421a-9576-e7f7f8930a9a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:20.893148 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a9a57533-ff65-421a-9576-e7f7f8930a9a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:21.015706 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a9a57533-ff65-421a-9576-e7f7f8930a9a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:21.029865 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a9a57533-ff65-421a-9576-e7f7f8930a9a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1192 microversion: 2.1 time: 0.157771 Jul 20 11:43:21.041005 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 405/796] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:20 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1192 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:21.178228 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6b26bf6-193b-47c2-87c6-747f27cca0f2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:21.190677 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6b26bf6-193b-47c2-87c6-747f27cca0f2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:21.193071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6b26bf6-193b-47c2-87c6-747f27cca0f2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:21.194585 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f6b26bf6-193b-47c2-87c6-747f27cca0f2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1809 microversion: 2.20 time: 0.440990 Jul 20 11:43:21.195899 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 392/797] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:20 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1809 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:22.047544 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-055dbcc9-90b4-4c5a-a11e-90ef6f262bc0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:22.048244 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-055dbcc9-90b4-4c5a-a11e-90ef6f262bc0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:22.056176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-055dbcc9-90b4-4c5a-a11e-90ef6f262bc0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:22.056732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-055dbcc9-90b4-4c5a-a11e-90ef6f262bc0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:22.057477 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-055dbcc9-90b4-4c5a-a11e-90ef6f262bc0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:22.058016 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-055dbcc9-90b4-4c5a-a11e-90ef6f262bc0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:22.122509 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-055dbcc9-90b4-4c5a-a11e-90ef6f262bc0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:22.132003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-055dbcc9-90b4-4c5a-a11e-90ef6f262bc0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1210 microversion: 2.1 time: 0.088233 Jul 20 11:43:22.132650 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 406/798] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:22 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:22.213181 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b68b0b36-9654-496b-b6cd-2be649f3a865 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:22.213827 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b68b0b36-9654-496b-b6cd-2be649f3a865 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:22.220543 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b68b0b36-9654-496b-b6cd-2be649f3a865 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:22.221037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b68b0b36-9654-496b-b6cd-2be649f3a865 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:22.221808 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b68b0b36-9654-496b-b6cd-2be649f3a865 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:22.222250 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b68b0b36-9654-496b-b6cd-2be649f3a865 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:22.377716 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b68b0b36-9654-496b-b6cd-2be649f3a865 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:22.387166 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b68b0b36-9654-496b-b6cd-2be649f3a865 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:22.388944 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b68b0b36-9654-496b-b6cd-2be649f3a865 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:22.390557 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b68b0b36-9654-496b-b6cd-2be649f3a865 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1796 microversion: 2.20 time: 0.181273 Jul 20 11:43:22.391116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 393/799] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:43:22 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1796 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:43:22.578763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-17570a72-2e9f-416b-b588-e0425b0eb54c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:22.579363 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-17570a72-2e9f-416b-b588-e0425b0eb54c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:22.580746 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-bea51af7-4131-4c95-b4bd-a82e873dead1 req-14811a20-9959-4a42-97f1-3c0f163a7654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ace499-ddc8-4a47-8e3d-730594d57bfa", "tag": "7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:22.586884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17570a72-2e9f-416b-b588-e0425b0eb54c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:22.587345 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17570a72-2e9f-416b-b588-e0425b0eb54c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:22.588125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17570a72-2e9f-416b-b588-e0425b0eb54c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:22.588576 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-17570a72-2e9f-416b-b588-e0425b0eb54c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:22.595964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-bea51af7-4131-4c95-b4bd-a82e873dead1 req-14811a20-9959-4a42-97f1-3c0f163a7654 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:22.600756 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-bea51af7-4131-4c95-b4bd-a82e873dead1 req-14811a20-9959-4a42-97f1-3c0f163a7654 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:22.634013 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-bea51af7-4131-4c95-b4bd-a82e873dead1 req-14811a20-9959-4a42-97f1-3c0f163a7654 service nova] Creating event network-changed:7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe for instance d0ace499-ddc8-4a47-8e3d-730594d57bfa on hv-cinder-82282 Jul 20 11:43:22.647628 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-bea51af7-4131-4c95-b4bd-a82e873dead1 req-14811a20-9959-4a42-97f1-3c0f163a7654 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070465 Jul 20 11:43:22.650399 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 394/800] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:43:22.692101 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-17570a72-2e9f-416b-b588-e0425b0eb54c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lazy-loading 'services' on Instance uuid d0ace499-ddc8-4a47-8e3d-730594d57bfa {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:43:22.986014 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-17570a72-2e9f-416b-b588-e0425b0eb54c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/os-volume_attachments/489f702a-c7cf-42e1-ad3c-7b0fd7db34e8" status: 202 len: 0 microversion: 2.1 time: 0.411433 Jul 20 11:43:22.986989 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 407/801] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 11:43:22 2022] DELETE /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/os-volume_attachments/489f702a-c7cf-42e1-ad3c-7b0fd7db34e8 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:43:23.007778 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-363c6945-6954-434f-a904-4a569223f279 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:23.010374 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-363c6945-6954-434f-a904-4a569223f279 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:23.031054 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-363c6945-6954-434f-a904-4a569223f279 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:23.032013 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-363c6945-6954-434f-a904-4a569223f279 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:23.034042 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-363c6945-6954-434f-a904-4a569223f279 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:23.035295 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-363c6945-6954-434f-a904-4a569223f279 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:23.088540 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-363c6945-6954-434f-a904-4a569223f279 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096410 Jul 20 11:43:23.090038 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 395/802] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:43:22 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:23.150971 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d2a60925-0ef0-4545-af38-2772fce11ba0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:23.151874 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d2a60925-0ef0-4545-af38-2772fce11ba0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:23.161519 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2a60925-0ef0-4545-af38-2772fce11ba0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:23.162302 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2a60925-0ef0-4545-af38-2772fce11ba0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:23.163457 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2a60925-0ef0-4545-af38-2772fce11ba0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:23.164269 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2a60925-0ef0-4545-af38-2772fce11ba0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:23.443705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d2a60925-0ef0-4545-af38-2772fce11ba0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:23.451771 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d2a60925-0ef0-4545-af38-2772fce11ba0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.306615 Jul 20 11:43:23.452347 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 408/803] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:23 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:24.101750 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d98d958e-5f99-41e0-80e3-522dbb0d2048 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:24.103237 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d98d958e-5f99-41e0-80e3-522dbb0d2048 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:24.109970 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d98d958e-5f99-41e0-80e3-522dbb0d2048 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:24.114433 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d98d958e-5f99-41e0-80e3-522dbb0d2048 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:24.114433 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d98d958e-5f99-41e0-80e3-522dbb0d2048 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:24.114433 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d98d958e-5f99-41e0-80e3-522dbb0d2048 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:24.141049 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d98d958e-5f99-41e0-80e3-522dbb0d2048 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043662 Jul 20 11:43:24.141551 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 396/804] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:43:24 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:43:24.468879 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6b9bf4a2-c8fb-4c5d-9d9c-9937878a98bb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:24.469623 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6b9bf4a2-c8fb-4c5d-9d9c-9937878a98bb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:24.476574 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b9bf4a2-c8fb-4c5d-9d9c-9937878a98bb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:24.477056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b9bf4a2-c8fb-4c5d-9d9c-9937878a98bb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:24.477826 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b9bf4a2-c8fb-4c5d-9d9c-9937878a98bb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:24.478261 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6b9bf4a2-c8fb-4c5d-9d9c-9937878a98bb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:24.633636 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1300171586", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85e4b01a-11ce-4686-bb2f-1c5b19de2e34"}], "security_groups": [{"name": "tempest-securitygroup--933684442"}], "key_name": "tempest-keypair-187577268", "user_data": "}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:24.689287 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6b9bf4a2-c8fb-4c5d-9d9c-9937878a98bb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:24.704322 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6b9bf4a2-c8fb-4c5d-9d9c-9937878a98bb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.237084 Jul 20 11:43:24.713071 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 409/805] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:24 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:24.717993 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-68db6e61-0535-45ac-90d0-80ea46066e67 req-721304f5-16ac-4be5-aef6-50a9c25f0a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c040895-6702-44a4-9b5f-db96396f225b", "tag": "98bd9704-51ee-4a9b-99c8-3ed18a4252e8"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:24.726885 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-68db6e61-0535-45ac-90d0-80ea46066e67 req-721304f5-16ac-4be5-aef6-50a9c25f0a36 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:24.727326 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-68db6e61-0535-45ac-90d0-80ea46066e67 req-721304f5-16ac-4be5-aef6-50a9c25f0a36 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:24.742905 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-68db6e61-0535-45ac-90d0-80ea46066e67 req-721304f5-16ac-4be5-aef6-50a9c25f0a36 service nova] Creating event network-changed:98bd9704-51ee-4a9b-99c8-3ed18a4252e8 for instance 9c040895-6702-44a4-9b5f-db96396f225b on hv-cinder-82282 Jul 20 11:43:24.748646 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-68db6e61-0535-45ac-90d0-80ea46066e67 req-721304f5-16ac-4be5-aef6-50a9c25f0a36 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034209 Jul 20 11:43:24.749945 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 410/806] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:24.759429 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] validate_networks() for [('85e4b01a-11ce-4686-bb2f-1c5b19de2e34', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:43:25.130688 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:43:25.131251 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:43:25.131554 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:43:25.131951 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:43:25.132351 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:43:25.141062 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.141498 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.142281 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.142715 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.153459 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-df270397-a405-4e6a-8b22-b1b00fe4aad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:25.154497 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-df270397-a405-4e6a-8b22-b1b00fe4aad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:25.159086 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for project d4fa73c956fe44a59272f727320743e0. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:43:25.160588 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df270397-a405-4e6a-8b22-b1b00fe4aad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.161615 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df270397-a405-4e6a-8b22-b1b00fe4aad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.162380 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df270397-a405-4e6a-8b22-b1b00fe4aad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.162815 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-df270397-a405-4e6a-8b22-b1b00fe4aad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.163523 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for user 54c7d577e64f48cab8c331ff192be0a6 and project d4fa73c956fe44a59272f727320743e0. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:43:25.174245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:43:25.176648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:43:25.190621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-df270397-a405-4e6a-8b22-b1b00fe4aad8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041401 Jul 20 11:43:25.191204 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 411/807] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:43:25 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 11:43:25.200624 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92cf9c02-6743-459b-aecf-2bf71afa93d0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:25.201142 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-92cf9c02-6743-459b-aecf-2bf71afa93d0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:25.207086 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92cf9c02-6743-459b-aecf-2bf71afa93d0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.207525 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92cf9c02-6743-459b-aecf-2bf71afa93d0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.208876 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92cf9c02-6743-459b-aecf-2bf71afa93d0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.209253 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92cf9c02-6743-459b-aecf-2bf71afa93d0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.283405 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-92cf9c02-6743-459b-aecf-2bf71afa93d0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] HTTP exception thrown: Instance d0ace499-ddc8-4a47-8e3d-730594d57bfa is not attached to volume 489f702a-c7cf-42e1-ad3c-7b0fd7db34e8 Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92cf9c02-6743-459b-aecf-2bf71afa93d0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Request method failure captured: Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/os-volume_attachments/489f702a-c7cf-42e1-ad3c-7b0fd7db34e8 HTTP/1.1 Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-jxQ28wCvpmtbzNDOsMmfDpNbfGXbTeceU9IRr8mfRhmEZgNHaCHClIxsJjrtmC45A5oW90qWDw-bvW08EbdKLZ1zLEXg7XVRuYCJ5_G-8iCM35m6WQlmoq5Z87BTqqH_33Kriotq-YArbRyaE1vgfMeM6IJK45aZ0kmAR2y1-kkl8 Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: afc92f5b75ea4f78869086626d7c2b4c Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-TestMinimumBasicScenario-497888260 Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:43:25.288147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:43:25.289862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/afc92f5b75ea4f78869086626d7c2b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/afc92f5b75ea4f78869086626d7c2b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_afc92f5b75ea4f78869086626d7c2b4c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/afc92f5b75ea4f78869086626d7c2b4c"}]}] Jul 20 11:43:25.289862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-TestMinimumBasicScenario-497888260 Jul 20 11:43:25.289862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: afc92f5b75ea4f78869086626d7c2b4c Jul 20 11:43:25.289862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-TestMinimumBasicScenario-497888260 Jul 20 11:43:25.289862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-TestMinimumBasicScenario-497888260-project Jul 20 11:43:25.289862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:43:25.289862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:43:25.289862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 0db227f5aa914cc7b0ab04ae3666fadb Jul 20 11:43:25.289862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-TestMinimumBasicScenario-497888260-project Jul 20 11:43:25.289862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:43:25.289862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance d0ace499-ddc8-4a47-8e3d-730594d57bfa is not attached to volume 489f702a-c7cf-42e1-ad3c-7b0fd7db34e8 Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'server_id': 'd0ace499-ddc8-4a47-8e3d-730594d57bfa', 'id': '489f702a-c7cf-42e1-ad3c-7b0fd7db34e8'} Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 489f702a-c7cf-42e1-ad3c-7b0fd7db34e8. Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:43:25.290732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0ace499-ddc8-4a47-8e3d-730594d57bfa is not attached to volume 489f702a-c7cf-42e1-ad3c-7b0fd7db34e8 Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0ace499-ddc8-4a47-8e3d-730594d57bfa is not attached to volume 489f702a-c7cf-42e1-ad3c-7b0fd7db34e8 Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:43:25.292229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92cf9c02-6743-459b-aecf-2bf71afa93d0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Returning 404 to user: Instance d0ace499-ddc8-4a47-8e3d-730594d57bfa is not attached to volume 489f702a-c7cf-42e1-ad3c-7b0fd7db34e8 {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:43:25.293431 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-92cf9c02-6743-459b-aecf-2bf71afa93d0 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/os-volume_attachments/489f702a-c7cf-42e1-ad3c-7b0fd7db34e8" status: 404 len: 154 microversion: 2.1 time: 0.092709 Jul 20 11:43:25.293431 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 412/808] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 11:43:25 2022] DELETE /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa/os-volume_attachments/489f702a-c7cf-42e1-ad3c-7b0fd7db34e8 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:43:25.315850 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b8692c04-bbcd-4f57-bc67-e79f3a8eb13b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.686968 Jul 20 11:43:25.316927 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 397/809] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:43:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:43:25.331321 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-03ae744b-205a-4614-96d8-a581f7749ea8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:25.331905 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-03ae744b-205a-4614-96d8-a581f7749ea8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:25.389073 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-03ae744b-205a-4614-96d8-a581f7749ea8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:25.396291 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-03ae744b-205a-4614-96d8-a581f7749ea8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1241 microversion: 2.1 time: 0.068157 Jul 20 11:43:25.396879 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 413/810] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:25 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:25.719564 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b69be2fb-144c-4384-b080-e247f3128b6c tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:25.720253 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b69be2fb-144c-4384-b080-e247f3128b6c tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:25.726744 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b69be2fb-144c-4384-b080-e247f3128b6c tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.727120 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b69be2fb-144c-4384-b080-e247f3128b6c tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.727944 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b69be2fb-144c-4384-b080-e247f3128b6c tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.728382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b69be2fb-144c-4384-b080-e247f3128b6c tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.940998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b69be2fb-144c-4384-b080-e247f3128b6c tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:25.951769 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b69be2fb-144c-4384-b080-e247f3128b6c tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.236086 Jul 20 11:43:25.953363 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 398/811] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:25 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:26.414006 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-22f1cc7e-af21-4e0a-ba6c-81f28d4629f2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:26.414894 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-22f1cc7e-af21-4e0a-ba6c-81f28d4629f2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:26.422368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22f1cc7e-af21-4e0a-ba6c-81f28d4629f2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:26.422878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22f1cc7e-af21-4e0a-ba6c-81f28d4629f2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:26.423654 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22f1cc7e-af21-4e0a-ba6c-81f28d4629f2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:26.424087 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-22f1cc7e-af21-4e0a-ba6c-81f28d4629f2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:26.494465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-22f1cc7e-af21-4e0a-ba6c-81f28d4629f2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:26.502774 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-22f1cc7e-af21-4e0a-ba6c-81f28d4629f2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1245 microversion: 2.1 time: 0.092989 Jul 20 11:43:26.503541 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 414/812] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:26 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:26.543308 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-099d552e-b572-47ca-a02c-b13cb4ec37e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:26.544853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-099d552e-b572-47ca-a02c-b13cb4ec37e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:26.552319 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-099d552e-b572-47ca-a02c-b13cb4ec37e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:26.553822 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-099d552e-b572-47ca-a02c-b13cb4ec37e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:26.553822 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-099d552e-b572-47ca-a02c-b13cb4ec37e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:26.554034 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-099d552e-b572-47ca-a02c-b13cb4ec37e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:26.590784 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-099d552e-b572-47ca-a02c-b13cb4ec37e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:43:26.891101 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-099d552e-b572-47ca-a02c-b13cb4ec37e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 204 len: 0 microversion: 2.1 time: 0.352187 Jul 20 11:43:26.891698 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 399/813] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:43:26 2022] DELETE /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:43:26.900003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-630b4015-c6c8-487c-af74-abbf31584494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:26.900612 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-630b4015-c6c8-487c-af74-abbf31584494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:26.906667 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-630b4015-c6c8-487c-af74-abbf31584494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:26.907104 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-630b4015-c6c8-487c-af74-abbf31584494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:26.907869 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-630b4015-c6c8-487c-af74-abbf31584494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:26.908290 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-630b4015-c6c8-487c-af74-abbf31584494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:26.969566 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fd86cddf-523c-4da6-85b5-b2442bc9ce0f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:26.970400 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fd86cddf-523c-4da6-85b5-b2442bc9ce0f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:26.972624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:26.977355 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd86cddf-523c-4da6-85b5-b2442bc9ce0f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:26.977811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd86cddf-523c-4da6-85b5-b2442bc9ce0f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:26.978587 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd86cddf-523c-4da6-85b5-b2442bc9ce0f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:26.979024 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd86cddf-523c-4da6-85b5-b2442bc9ce0f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:26.999398 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:27.047024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-630b4015-c6c8-487c-af74-abbf31584494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:27.055547 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-630b4015-c6c8-487c-af74-abbf31584494 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1555 microversion: 2.1 time: 0.159581 Jul 20 11:43:27.056609 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 415/814] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:26 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:27.262103 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fd86cddf-523c-4da6-85b5-b2442bc9ce0f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:27.269431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fd86cddf-523c-4da6-85b5-b2442bc9ce0f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.304148 Jul 20 11:43:27.269988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 400/815] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:26 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:27.519558 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e8568796-6ef2-4967-8592-8ab1f02c2f50 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:27.520168 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e8568796-6ef2-4967-8592-8ab1f02c2f50 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:27.527464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8568796-6ef2-4967-8592-8ab1f02c2f50 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:27.527911 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8568796-6ef2-4967-8592-8ab1f02c2f50 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:27.528677 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8568796-6ef2-4967-8592-8ab1f02c2f50 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:27.529148 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e8568796-6ef2-4967-8592-8ab1f02c2f50 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:27.588666 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e8568796-6ef2-4967-8592-8ab1f02c2f50 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:27.595957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e8568796-6ef2-4967-8592-8ab1f02c2f50 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1237 microversion: 2.1 time: 0.080235 Jul 20 11:43:27.596520 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 416/816] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:27 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:28.074420 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ac29e5bf-7511-42e8-925b-076844e1e804 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:28.076871 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ac29e5bf-7511-42e8-925b-076844e1e804 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:28.082202 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac29e5bf-7511-42e8-925b-076844e1e804 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.082404 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac29e5bf-7511-42e8-925b-076844e1e804 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.083816 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac29e5bf-7511-42e8-925b-076844e1e804 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.084249 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ac29e5bf-7511-42e8-925b-076844e1e804 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.216194 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ac29e5bf-7511-42e8-925b-076844e1e804 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:28.223593 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ac29e5bf-7511-42e8-925b-076844e1e804 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1555 microversion: 2.1 time: 0.153612 Jul 20 11:43:28.224148 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 401/817] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:28 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:28.285566 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b9a4d9b2-8def-4df4-8bbd-c641582969ff tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:28.286176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b9a4d9b2-8def-4df4-8bbd-c641582969ff tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:28.292124 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9a4d9b2-8def-4df4-8bbd-c641582969ff tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.292574 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9a4d9b2-8def-4df4-8bbd-c641582969ff tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.293369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9a4d9b2-8def-4df4-8bbd-c641582969ff tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.293805 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9a4d9b2-8def-4df4-8bbd-c641582969ff tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.427582 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b9a4d9b2-8def-4df4-8bbd-c641582969ff tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:28.435001 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b9a4d9b2-8def-4df4-8bbd-c641582969ff tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.153387 Jul 20 11:43:28.435562 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 417/818] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:28 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:28.613502 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fcf55535-10c9-4915-a4a9-6264185024dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:28.614646 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fcf55535-10c9-4915-a4a9-6264185024dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:28.620708 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcf55535-10c9-4915-a4a9-6264185024dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.621184 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcf55535-10c9-4915-a4a9-6264185024dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.621975 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcf55535-10c9-4915-a4a9-6264185024dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.622407 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fcf55535-10c9-4915-a4a9-6264185024dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.683497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fcf55535-10c9-4915-a4a9-6264185024dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:28.690860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fcf55535-10c9-4915-a4a9-6264185024dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1293 microversion: 2.1 time: 0.081193 Jul 20 11:43:28.691409 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 402/819] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:28 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:29.242298 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-54f2d1b3-5ffe-4912-a94a-990954cb64d9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:29.243307 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-54f2d1b3-5ffe-4912-a94a-990954cb64d9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:29.250084 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54f2d1b3-5ffe-4912-a94a-990954cb64d9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:29.250678 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54f2d1b3-5ffe-4912-a94a-990954cb64d9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:29.251390 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54f2d1b3-5ffe-4912-a94a-990954cb64d9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:29.251823 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-54f2d1b3-5ffe-4912-a94a-990954cb64d9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:29.257085 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:29.451655 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-54f2d1b3-5ffe-4912-a94a-990954cb64d9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:29.453977 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a56747b-5f86-42f2-b1db-636b8f7b2259 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:29.462117 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a56747b-5f86-42f2-b1db-636b8f7b2259 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:29.462252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-54f2d1b3-5ffe-4912-a94a-990954cb64d9 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1555 microversion: 2.1 time: 0.223110 Jul 20 11:43:29.462252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 418/820] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:29 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1555 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:29.462444 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a56747b-5f86-42f2-b1db-636b8f7b2259 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:29.462444 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a56747b-5f86-42f2-b1db-636b8f7b2259 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:29.463039 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a56747b-5f86-42f2-b1db-636b8f7b2259 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:29.463688 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a56747b-5f86-42f2-b1db-636b8f7b2259 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:29.651868 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a56747b-5f86-42f2-b1db-636b8f7b2259 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:29.657866 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a56747b-5f86-42f2-b1db-636b8f7b2259 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.209318 Jul 20 11:43:29.664977 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 403/821] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:29 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:29.682546 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-2ff9715c-5f22-4482-a831-4b03937d4f35 req-cf1adcd1-a7f0-47e5-aeea-ea9b45425d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ace499-ddc8-4a47-8e3d-730594d57bfa", "name": "network-vif-deleted", "tag": "7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:29.691003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-2ff9715c-5f22-4482-a831-4b03937d4f35 req-cf1adcd1-a7f0-47e5-aeea-ea9b45425d2f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:29.693105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-2ff9715c-5f22-4482-a831-4b03937d4f35 req-cf1adcd1-a7f0-47e5-aeea-ea9b45425d2f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:29.707927 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c9187f73-112a-4388-a751-9d0c10672d98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:29.710884 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c9187f73-112a-4388-a751-9d0c10672d98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:29.718288 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c9187f73-112a-4388-a751-9d0c10672d98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:29.720990 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c9187f73-112a-4388-a751-9d0c10672d98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:29.720990 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c9187f73-112a-4388-a751-9d0c10672d98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:29.720990 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c9187f73-112a-4388-a751-9d0c10672d98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:29.795776 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c9187f73-112a-4388-a751-9d0c10672d98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:29.804931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c9187f73-112a-4388-a751-9d0c10672d98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1301 microversion: 2.1 time: 0.101017 Jul 20 11:43:29.810331 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 404/822] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:29 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1301 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:29.855721 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-2ff9715c-5f22-4482-a831-4b03937d4f35 req-cf1adcd1-a7f0-47e5-aeea-ea9b45425d2f service nova] Creating event network-vif-deleted:7610cbf9-208d-4d32-89d1-4a8a9fb4bcfe for instance d0ace499-ddc8-4a47-8e3d-730594d57bfa on hv-cinder-82282 Jul 20 11:43:29.860835 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-2ff9715c-5f22-4482-a831-4b03937d4f35 req-cf1adcd1-a7f0-47e5-aeea-ea9b45425d2f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182174 Jul 20 11:43:29.861736 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 419/823] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:30.478308 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56947afa-335d-4c77-a64a-82ccea895851 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:30.478942 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-56947afa-335d-4c77-a64a-82ccea895851 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:30.485510 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56947afa-335d-4c77-a64a-82ccea895851 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:30.485961 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56947afa-335d-4c77-a64a-82ccea895851 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:30.486724 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56947afa-335d-4c77-a64a-82ccea895851 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:30.487156 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56947afa-335d-4c77-a64a-82ccea895851 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:30.517024 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56947afa-335d-4c77-a64a-82ccea895851 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:30.517496 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-56947afa-335d-4c77-a64a-82ccea895851 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:30.517987 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-56947afa-335d-4c77-a64a-82ccea895851 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lazy-loading 'fault' on Instance uuid d0ace499-ddc8-4a47-8e3d-730594d57bfa {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:43:30.559795 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-56947afa-335d-4c77-a64a-82ccea895851 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:30.567203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56947afa-335d-4c77-a64a-82ccea895851 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1348 microversion: 2.1 time: 0.093382 Jul 20 11:43:30.568715 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 405/824] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:30 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:30.675275 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-588566cc-0ad7-4f82-b95d-a515230b7d77 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:30.676092 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-588566cc-0ad7-4f82-b95d-a515230b7d77 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:30.683389 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-588566cc-0ad7-4f82-b95d-a515230b7d77 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:30.683839 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-588566cc-0ad7-4f82-b95d-a515230b7d77 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:30.684608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-588566cc-0ad7-4f82-b95d-a515230b7d77 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:30.685065 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-588566cc-0ad7-4f82-b95d-a515230b7d77 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:30.822846 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f84a9050-21c5-47fb-96cc-d0a9b35691da tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:30.823560 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f84a9050-21c5-47fb-96cc-d0a9b35691da tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:30.825741 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-588566cc-0ad7-4f82-b95d-a515230b7d77 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:30.829561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f84a9050-21c5-47fb-96cc-d0a9b35691da tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:30.830003 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f84a9050-21c5-47fb-96cc-d0a9b35691da tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:30.830768 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f84a9050-21c5-47fb-96cc-d0a9b35691da tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:30.831224 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f84a9050-21c5-47fb-96cc-d0a9b35691da tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:30.833804 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-588566cc-0ad7-4f82-b95d-a515230b7d77 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.163218 Jul 20 11:43:30.834408 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 420/825] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:30 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:30.962284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f84a9050-21c5-47fb-96cc-d0a9b35691da tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:30.970038 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f84a9050-21c5-47fb-96cc-d0a9b35691da tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1366 microversion: 2.1 time: 0.150969 Jul 20 11:43:30.970613 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 406/826] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:30 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:31.585712 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-651e4863-f7f3-47d4-a8fc-3486b22605e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:31.586546 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-651e4863-f7f3-47d4-a8fc-3486b22605e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:31.592666 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-651e4863-f7f3-47d4-a8fc-3486b22605e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:31.593149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-651e4863-f7f3-47d4-a8fc-3486b22605e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:31.593928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-651e4863-f7f3-47d4-a8fc-3486b22605e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:31.594544 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-651e4863-f7f3-47d4-a8fc-3486b22605e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:31.633652 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-651e4863-f7f3-47d4-a8fc-3486b22605e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:31.634099 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-651e4863-f7f3-47d4-a8fc-3486b22605e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:31.634840 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-651e4863-f7f3-47d4-a8fc-3486b22605e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lazy-loading 'fault' on Instance uuid d0ace499-ddc8-4a47-8e3d-730594d57bfa {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:43:31.681353 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-651e4863-f7f3-47d4-a8fc-3486b22605e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db227f5aa914cc7b0ab04ae3666fadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92f5b75ea4f78869086626d7c2b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:31.689171 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-651e4863-f7f3-47d4-a8fc-3486b22605e8 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 200 len: 1348 microversion: 2.1 time: 0.107903 Jul 20 11:43:31.690272 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 421/827] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:31 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 1348 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:31.853512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7de9d934-e1da-4c25-b61e-1c75b7ecadbf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:31.853512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7de9d934-e1da-4c25-b61e-1c75b7ecadbf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:31.858024 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7de9d934-e1da-4c25-b61e-1c75b7ecadbf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:31.858480 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7de9d934-e1da-4c25-b61e-1c75b7ecadbf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:31.859280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7de9d934-e1da-4c25-b61e-1c75b7ecadbf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:31.859722 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7de9d934-e1da-4c25-b61e-1c75b7ecadbf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:31.942642 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-5cb0f483-c002-46a2-ac3d-ddcf5369b1b3 req-cc128cb4-9ab4-4552-9f3a-ff8a2bc6ae29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd665a70-b047-4bf2-b775-2f93e1be084c", "tag": "d410a05b-4bb6-4dde-aed0-6560bd683bc1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:31.951598 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5cb0f483-c002-46a2-ac3d-ddcf5369b1b3 req-cc128cb4-9ab4-4552-9f3a-ff8a2bc6ae29 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:31.952046 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5cb0f483-c002-46a2-ac3d-ddcf5369b1b3 req-cc128cb4-9ab4-4552-9f3a-ff8a2bc6ae29 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:31.965018 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-5cb0f483-c002-46a2-ac3d-ddcf5369b1b3 req-cc128cb4-9ab4-4552-9f3a-ff8a2bc6ae29 service nova] Creating event network-changed:d410a05b-4bb6-4dde-aed0-6560bd683bc1 for instance fd665a70-b047-4bf2-b775-2f93e1be084c on hv-cinder-82282 Jul 20 11:43:31.970383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-5cb0f483-c002-46a2-ac3d-ddcf5369b1b3 req-cc128cb4-9ab4-4552-9f3a-ff8a2bc6ae29 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031977 Jul 20 11:43:31.971618 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 422/828] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:31.991745 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b6e0f9b6-1bfc-417c-b78e-5503156dcb07 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:31.992662 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b6e0f9b6-1bfc-417c-b78e-5503156dcb07 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:31.999504 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6e0f9b6-1bfc-417c-b78e-5503156dcb07 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:32.000027 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6e0f9b6-1bfc-417c-b78e-5503156dcb07 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:32.000933 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6e0f9b6-1bfc-417c-b78e-5503156dcb07 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:32.001448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b6e0f9b6-1bfc-417c-b78e-5503156dcb07 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:32.013903 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7de9d934-e1da-4c25-b61e-1c75b7ecadbf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:32.022021 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7de9d934-e1da-4c25-b61e-1c75b7ecadbf tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.175368 Jul 20 11:43:32.032041 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 407/829] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:31 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:32.138567 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b6e0f9b6-1bfc-417c-b78e-5503156dcb07 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:32.145932 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b6e0f9b6-1bfc-417c-b78e-5503156dcb07 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1366 microversion: 2.1 time: 0.162066 Jul 20 11:43:32.146491 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 423/830] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:31 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:32.705957 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2afcd749-7da7-4463-8b2c-f0f680efb52c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:32.706688 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2afcd749-7da7-4463-8b2c-f0f680efb52c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] [instance: d0ace499-ddc8-4a47-8e3d-730594d57bfa] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:32.713314 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2afcd749-7da7-4463-8b2c-f0f680efb52c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:32.713764 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2afcd749-7da7-4463-8b2c-f0f680efb52c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:32.714704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2afcd749-7da7-4463-8b2c-f0f680efb52c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:32.715152 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2afcd749-7da7-4463-8b2c-f0f680efb52c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:32.729359 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-2afcd749-7da7-4463-8b2c-f0f680efb52c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] HTTP exception thrown: Instance d0ace499-ddc8-4a47-8e3d-730594d57bfa could not be found. Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2afcd749-7da7-4463-8b2c-f0f680efb52c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Request method failure captured: Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa HTTP/1.1 Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-jxQ28wCvpmtbzNDOsMmfDpNbfGXbTeceU9IRr8mfRhmEZgNHaCHClIxsJjrtmC45A5oW90qWDw-bvW08EbdKLZ1zLEXg7XVRuYCJ5_G-8iCM35m6WQlmoq5Z87BTqqH_33Kriotq-YArbRyaE1vgfMeM6IJK45aZ0kmAR2y1-kkl8 Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: afc92f5b75ea4f78869086626d7c2b4c Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestMinimumBasicScenario-497888260 Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:43:32.731053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:43:32.732974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/afc92f5b75ea4f78869086626d7c2b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/afc92f5b75ea4f78869086626d7c2b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_afc92f5b75ea4f78869086626d7c2b4c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/afc92f5b75ea4f78869086626d7c2b4c"}]}] Jul 20 11:43:32.732974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestMinimumBasicScenario-497888260 Jul 20 11:43:32.732974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: afc92f5b75ea4f78869086626d7c2b4c Jul 20 11:43:32.732974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestMinimumBasicScenario-497888260 Jul 20 11:43:32.732974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-TestMinimumBasicScenario-497888260-project Jul 20 11:43:32.732974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:43:32.732974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:43:32.732974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 0db227f5aa914cc7b0ab04ae3666fadb Jul 20 11:43:32.732974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestMinimumBasicScenario-497888260-project Jul 20 11:43:32.732974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:43:32.732974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance d0ace499-ddc8-4a47-8e3d-730594d57bfa could not be found. Jul 20 11:43:32.732974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'd0ace499-ddc8-4a47-8e3d-730594d57bfa'} Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0ace499-ddc8-4a47-8e3d-730594d57bfa could not be found. Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:43:32.733780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0ace499-ddc8-4a47-8e3d-730594d57bfa could not be found. Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0ace499-ddc8-4a47-8e3d-730594d57bfa could not be found. Jul 20 11:43:32.735091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:43:32.736628 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2afcd749-7da7-4463-8b2c-f0f680efb52c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Returning 404 to user: Instance d0ace499-ddc8-4a47-8e3d-730594d57bfa could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:43:32.736628 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2afcd749-7da7-4463-8b2c-f0f680efb52c tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa" status: 404 len: 111 microversion: 2.1 time: 0.030330 Jul 20 11:43:32.736628 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 408/831] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:32 2022] GET /compute/v2.1/servers/d0ace499-ddc8-4a47-8e3d-730594d57bfa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:43:32.741033 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d70a8b0c-2714-4a9d-b39e-25d1c4e9a2e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] Calling method '.version_select at 0x7f44dae29ca0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:32.818360 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d70a8b0c-2714-4a9d-b39e-25d1c4e9a2e6 tempest-TestMinimumBasicScenario-497888260 tempest-TestMinimumBasicScenario-497888260-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1342398398" status: 202 len: 0 microversion: 2.1 time: 0.081011 Jul 20 11:43:32.819010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 424/832] 10.222.0.43 () {58 vars in 1271 bytes} [Wed Jul 20 11:43:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1342398398 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:43:33.040119 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d341882f-ebf7-40e0-8c67-62620db7f2dd tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:33.040736 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d341882f-ebf7-40e0-8c67-62620db7f2dd tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:33.047277 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d341882f-ebf7-40e0-8c67-62620db7f2dd tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:33.047726 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d341882f-ebf7-40e0-8c67-62620db7f2dd tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:33.048496 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d341882f-ebf7-40e0-8c67-62620db7f2dd tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:33.049032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d341882f-ebf7-40e0-8c67-62620db7f2dd tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:33.163013 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ba0e3a24-8aea-43c3-b6a6-d6257ebe6541 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:33.163627 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ba0e3a24-8aea-43c3-b6a6-d6257ebe6541 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:33.165735 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:33.171203 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba0e3a24-8aea-43c3-b6a6-d6257ebe6541 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:33.171660 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba0e3a24-8aea-43c3-b6a6-d6257ebe6541 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:33.172438 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba0e3a24-8aea-43c3-b6a6-d6257ebe6541 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:33.172912 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ba0e3a24-8aea-43c3-b6a6-d6257ebe6541 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:33.190226 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d341882f-ebf7-40e0-8c67-62620db7f2dd tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:33.195065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d341882f-ebf7-40e0-8c67-62620db7f2dd tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.159469 Jul 20 11:43:33.195628 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 409/833] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:33 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:33.302605 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ba0e3a24-8aea-43c3-b6a6-d6257ebe6541 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:33.310302 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ba0e3a24-8aea-43c3-b6a6-d6257ebe6541 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1366 microversion: 2.1 time: 0.151243 Jul 20 11:43:33.310865 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 425/834] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:33 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:34.212012 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3409e543-969a-4217-bea3-fe8c7d05ddfa tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:34.212621 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3409e543-969a-4217-bea3-fe8c7d05ddfa tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:34.219079 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3409e543-969a-4217-bea3-fe8c7d05ddfa tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:34.219518 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3409e543-969a-4217-bea3-fe8c7d05ddfa tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:34.220277 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3409e543-969a-4217-bea3-fe8c7d05ddfa tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:34.220705 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3409e543-969a-4217-bea3-fe8c7d05ddfa tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:34.327716 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c5c5ed33-809f-477e-be01-91a98a03ebf7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:34.328391 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c5c5ed33-809f-477e-be01-91a98a03ebf7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:34.335007 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5c5ed33-809f-477e-be01-91a98a03ebf7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:34.336357 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5c5ed33-809f-477e-be01-91a98a03ebf7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:34.336357 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5c5ed33-809f-477e-be01-91a98a03ebf7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:34.336646 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5c5ed33-809f-477e-be01-91a98a03ebf7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:34.356370 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3409e543-969a-4217-bea3-fe8c7d05ddfa tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:34.370214 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3409e543-969a-4217-bea3-fe8c7d05ddfa tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.162048 Jul 20 11:43:34.370806 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 410/835] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:34 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:34.471262 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c5c5ed33-809f-477e-be01-91a98a03ebf7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:34.478824 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c5c5ed33-809f-477e-be01-91a98a03ebf7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1366 microversion: 2.1 time: 0.154952 Jul 20 11:43:34.479467 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 426/836] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:34 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:35.386981 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8eaf0bc1-65a5-436e-b285-5d771c3857c7 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:35.388231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8eaf0bc1-65a5-436e-b285-5d771c3857c7 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:35.391366 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:35.392150 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=16 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:35.396209 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8eaf0bc1-65a5-436e-b285-5d771c3857c7 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:35.396662 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8eaf0bc1-65a5-436e-b285-5d771c3857c7 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:35.403296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8eaf0bc1-65a5-436e-b285-5d771c3857c7 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:35.403755 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8eaf0bc1-65a5-436e-b285-5d771c3857c7 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:35.496289 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eee4d972-c2e1-4c97-a054-91c2ee2a5f78 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:35.497987 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eee4d972-c2e1-4c97-a054-91c2ee2a5f78 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:35.499937 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:35.506950 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eee4d972-c2e1-4c97-a054-91c2ee2a5f78 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:35.509886 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eee4d972-c2e1-4c97-a054-91c2ee2a5f78 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:35.510797 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eee4d972-c2e1-4c97-a054-91c2ee2a5f78 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:35.511436 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eee4d972-c2e1-4c97-a054-91c2ee2a5f78 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:35.590302 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8eaf0bc1-65a5-436e-b285-5d771c3857c7 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:35.598068 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8eaf0bc1-65a5-436e-b285-5d771c3857c7 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.214884 Jul 20 11:43:35.608147 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 411/837] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:35 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:35.696158 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eee4d972-c2e1-4c97-a054-91c2ee2a5f78 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:35.703569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eee4d972-c2e1-4c97-a054-91c2ee2a5f78 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1366 microversion: 2.1 time: 0.211313 Jul 20 11:43:35.704636 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 427/838] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:35 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:36.615701 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fe9fcdbd-a608-4555-99b6-8eb359138f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:36.622466 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fe9fcdbd-a608-4555-99b6-8eb359138f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:36.624850 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe9fcdbd-a608-4555-99b6-8eb359138f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:36.625411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe9fcdbd-a608-4555-99b6-8eb359138f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:36.626306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe9fcdbd-a608-4555-99b6-8eb359138f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:36.626837 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fe9fcdbd-a608-4555-99b6-8eb359138f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:36.725772 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e23f86cd-d5fd-48ea-8bff-a5fab0a75e31 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:36.731653 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e23f86cd-d5fd-48ea-8bff-a5fab0a75e31 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:36.740549 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e23f86cd-d5fd-48ea-8bff-a5fab0a75e31 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:36.741346 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e23f86cd-d5fd-48ea-8bff-a5fab0a75e31 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:36.742299 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e23f86cd-d5fd-48ea-8bff-a5fab0a75e31 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:36.742900 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e23f86cd-d5fd-48ea-8bff-a5fab0a75e31 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:36.783490 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fe9fcdbd-a608-4555-99b6-8eb359138f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:36.791612 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fe9fcdbd-a608-4555-99b6-8eb359138f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.180007 Jul 20 11:43:36.792188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 412/839] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:36 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:36.921441 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e23f86cd-d5fd-48ea-8bff-a5fab0a75e31 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:36.935375 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e23f86cd-d5fd-48ea-8bff-a5fab0a75e31 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1366 microversion: 2.1 time: 0.217752 Jul 20 11:43:36.936577 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 428/840] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:36 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:37.046304 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-39b3b4a0-9b46-4123-8256-578432e04a8d req-532567a3-e0f3-4b42-b885-231406f2b07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c040895-6702-44a4-9b5f-db96396f225b", "name": "network-vif-plugged", "status": "completed", "tag": "98bd9704-51ee-4a9b-99c8-3ed18a4252e8"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:37.055181 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-39b3b4a0-9b46-4123-8256-578432e04a8d req-532567a3-e0f3-4b42-b885-231406f2b07d service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:37.055997 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-39b3b4a0-9b46-4123-8256-578432e04a8d req-532567a3-e0f3-4b42-b885-231406f2b07d service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:37.068453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-39b3b4a0-9b46-4123-8256-578432e04a8d req-532567a3-e0f3-4b42-b885-231406f2b07d service nova] Creating event network-vif-plugged:98bd9704-51ee-4a9b-99c8-3ed18a4252e8 for instance 9c040895-6702-44a4-9b5f-db96396f225b on hv-cinder-82282 Jul 20 11:43:37.073726 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-39b3b4a0-9b46-4123-8256-578432e04a8d req-532567a3-e0f3-4b42-b885-231406f2b07d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031914 Jul 20 11:43:37.074344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 413/841] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:37.808946 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-070c0329-870f-48ca-90e0-b42ff82eb5db tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:37.809628 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-070c0329-870f-48ca-90e0-b42ff82eb5db tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:37.816174 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-070c0329-870f-48ca-90e0-b42ff82eb5db tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:37.816855 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-070c0329-870f-48ca-90e0-b42ff82eb5db tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:37.817679 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-070c0329-870f-48ca-90e0-b42ff82eb5db tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:37.818117 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-070c0329-870f-48ca-90e0-b42ff82eb5db tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:37.956977 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1d0c02f7-accc-46be-a533-9258be30250c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:37.959443 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1d0c02f7-accc-46be-a533-9258be30250c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:37.968508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d0c02f7-accc-46be-a533-9258be30250c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:37.972931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d0c02f7-accc-46be-a533-9258be30250c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:37.972931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d0c02f7-accc-46be-a533-9258be30250c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:37.973184 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-070c0329-870f-48ca-90e0-b42ff82eb5db tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:37.973347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1d0c02f7-accc-46be-a533-9258be30250c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:37.980176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-070c0329-870f-48ca-90e0-b42ff82eb5db tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.175030 Jul 20 11:43:37.981044 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 429/842] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:37 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:38.136249 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1d0c02f7-accc-46be-a533-9258be30250c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:38.143328 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1d0c02f7-accc-46be-a533-9258be30250c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1366 microversion: 2.1 time: 0.192647 Jul 20 11:43:38.153678 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 414/843] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:37 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:39.001533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c822ff95-4940-467d-8a78-a5cada0bc284 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:39.001533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c822ff95-4940-467d-8a78-a5cada0bc284 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:39.005086 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c822ff95-4940-467d-8a78-a5cada0bc284 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:39.005535 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c822ff95-4940-467d-8a78-a5cada0bc284 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:39.006466 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c822ff95-4940-467d-8a78-a5cada0bc284 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:39.006996 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c822ff95-4940-467d-8a78-a5cada0bc284 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:39.163447 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8bdc19cb-8920-451b-af27-a293b5ce7e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:39.163447 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8bdc19cb-8920-451b-af27-a293b5ce7e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:39.171050 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8bdc19cb-8920-451b-af27-a293b5ce7e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:39.171571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8bdc19cb-8920-451b-af27-a293b5ce7e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:39.172410 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8bdc19cb-8920-451b-af27-a293b5ce7e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:39.173140 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8bdc19cb-8920-451b-af27-a293b5ce7e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:39.242711 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c822ff95-4940-467d-8a78-a5cada0bc284 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:39.250807 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c822ff95-4940-467d-8a78-a5cada0bc284 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1266 microversion: 2.1 time: 0.256827 Jul 20 11:43:39.251415 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 430/844] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:38 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:39.402914 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-b1118d3d-fcfd-4463-87a4-d65c2698bbfb req-da70dcba-c60d-4c5f-a909-bab0291b8fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd665a70-b047-4bf2-b775-2f93e1be084c", "name": "network-vif-plugged", "status": "completed", "tag": "d410a05b-4bb6-4dde-aed0-6560bd683bc1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:39.412626 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-b1118d3d-fcfd-4463-87a4-d65c2698bbfb req-da70dcba-c60d-4c5f-a909-bab0291b8fdb service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:39.413470 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-b1118d3d-fcfd-4463-87a4-d65c2698bbfb req-da70dcba-c60d-4c5f-a909-bab0291b8fdb service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:39.414831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8bdc19cb-8920-451b-af27-a293b5ce7e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:39.422799 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8bdc19cb-8920-451b-af27-a293b5ce7e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1366 microversion: 2.1 time: 0.266297 Jul 20 11:43:39.425261 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 415/845] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:39 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:39.428825 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-b1118d3d-fcfd-4463-87a4-d65c2698bbfb req-da70dcba-c60d-4c5f-a909-bab0291b8fdb service nova] Creating event network-vif-plugged:d410a05b-4bb6-4dde-aed0-6560bd683bc1 for instance fd665a70-b047-4bf2-b775-2f93e1be084c on hv-cinder-82282 Jul 20 11:43:39.434296 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-b1118d3d-fcfd-4463-87a4-d65c2698bbfb req-da70dcba-c60d-4c5f-a909-bab0291b8fdb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035801 Jul 20 11:43:39.435020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 431/846] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:40.267649 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2feab955-8b4d-450c-9b44-9ff22798a2b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:40.268424 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2feab955-8b4d-450c-9b44-9ff22798a2b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:40.281968 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2feab955-8b4d-450c-9b44-9ff22798a2b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:40.281968 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2feab955-8b4d-450c-9b44-9ff22798a2b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:40.281968 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2feab955-8b4d-450c-9b44-9ff22798a2b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:40.281968 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2feab955-8b4d-450c-9b44-9ff22798a2b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:40.448805 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b20e0f23-c195-4659-a470-0cfb305f2ab5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:40.449647 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b20e0f23-c195-4659-a470-0cfb305f2ab5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:40.456687 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b20e0f23-c195-4659-a470-0cfb305f2ab5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:40.457163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b20e0f23-c195-4659-a470-0cfb305f2ab5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:40.457946 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b20e0f23-c195-4659-a470-0cfb305f2ab5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:40.458386 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b20e0f23-c195-4659-a470-0cfb305f2ab5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:40.782570 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2feab955-8b4d-450c-9b44-9ff22798a2b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:40.785647 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b20e0f23-c195-4659-a470-0cfb305f2ab5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:40.790380 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2feab955-8b4d-450c-9b44-9ff22798a2b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1453 microversion: 2.1 time: 0.526826 Jul 20 11:43:40.790948 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 416/847] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:40 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1453 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:40.793116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b20e0f23-c195-4659-a470-0cfb305f2ab5 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1366 microversion: 2.1 time: 0.348614 Jul 20 11:43:40.793672 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 432/848] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:40 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:40.806044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-665f34a9-9bd4-4834-bf40-9bf3886651b0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:40.810945 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-665f34a9-9bd4-4834-bf40-9bf3886651b0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:40.812556 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-665f34a9-9bd4-4834-bf40-9bf3886651b0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:40.813032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-665f34a9-9bd4-4834-bf40-9bf3886651b0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:40.813797 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-665f34a9-9bd4-4834-bf40-9bf3886651b0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:40.814231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-665f34a9-9bd4-4834-bf40-9bf3886651b0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:41.095869 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-665f34a9-9bd4-4834-bf40-9bf3886651b0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:41.103764 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-665f34a9-9bd4-4834-bf40-9bf3886651b0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1453 microversion: 2.1 time: 0.301446 Jul 20 11:43:41.104374 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 417/849] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:40 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1453 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:41.813298 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c1d34354-50ec-4f11-bcd1-44a02d503aa1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:41.814512 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c1d34354-50ec-4f11-bcd1-44a02d503aa1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:41.836572 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1d34354-50ec-4f11-bcd1-44a02d503aa1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:41.840060 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1d34354-50ec-4f11-bcd1-44a02d503aa1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:41.845964 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1d34354-50ec-4f11-bcd1-44a02d503aa1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:41.845964 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1d34354-50ec-4f11-bcd1-44a02d503aa1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:42.030623 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c1d34354-50ec-4f11-bcd1-44a02d503aa1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:42.038317 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c1d34354-50ec-4f11-bcd1-44a02d503aa1 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1366 microversion: 2.1 time: 0.232221 Jul 20 11:43:42.042444 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 433/850] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:41 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:43.055629 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b1015c87-9b5b-4b5f-a83b-9bec61df9bd7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:43.056347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b1015c87-9b5b-4b5f-a83b-9bec61df9bd7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:43.065390 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1015c87-9b5b-4b5f-a83b-9bec61df9bd7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:43.066312 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1015c87-9b5b-4b5f-a83b-9bec61df9bd7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:43.066810 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1015c87-9b5b-4b5f-a83b-9bec61df9bd7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:43.067940 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1015c87-9b5b-4b5f-a83b-9bec61df9bd7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:43.087872 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=100 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:43.218581 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b1015c87-9b5b-4b5f-a83b-9bec61df9bd7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:43.221397 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-e2481e81-24b9-4bad-be03-e0303f04440e req-1bcc0bed-240f-4788-8474-247f729348b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c040895-6702-44a4-9b5f-db96396f225b", "tag": "98bd9704-51ee-4a9b-99c8-3ed18a4252e8"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:43.227405 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b1015c87-9b5b-4b5f-a83b-9bec61df9bd7 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1555 microversion: 2.1 time: 0.175774 Jul 20 11:43:43.228747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 418/851] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:43 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:43.230102 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e2481e81-24b9-4bad-be03-e0303f04440e req-1bcc0bed-240f-4788-8474-247f729348b2 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:43.230539 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e2481e81-24b9-4bad-be03-e0303f04440e req-1bcc0bed-240f-4788-8474-247f729348b2 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:43.243865 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-e2481e81-24b9-4bad-be03-e0303f04440e req-1bcc0bed-240f-4788-8474-247f729348b2 service nova] Creating event network-changed:98bd9704-51ee-4a9b-99c8-3ed18a4252e8 for instance 9c040895-6702-44a4-9b5f-db96396f225b on hv-cinder-82282 Jul 20 11:43:43.248965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-e2481e81-24b9-4bad-be03-e0303f04440e req-1bcc0bed-240f-4788-8474-247f729348b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031325 Jul 20 11:43:43.250102 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 434/852] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:43:43.255937 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ef6e2761-5682-43f0-8881-ef421fa808fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:43.256505 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ef6e2761-5682-43f0-8881-ef421fa808fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:43.262610 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef6e2761-5682-43f0-8881-ef421fa808fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:43.264895 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef6e2761-5682-43f0-8881-ef421fa808fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:43.264895 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef6e2761-5682-43f0-8881-ef421fa808fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:43.264895 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ef6e2761-5682-43f0-8881-ef421fa808fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:43.350100 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ef6e2761-5682-43f0-8881-ef421fa808fb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103749 Jul 20 11:43:43.351045 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 419/853] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 11:43:43 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:44.532985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-8024ea2d-5a36-4803-b4c9-eacb8a76977b req-0db10c80-c80b-43e1-9f00-8867c6093bcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd665a70-b047-4bf2-b775-2f93e1be084c", "tag": "d410a05b-4bb6-4dde-aed0-6560bd683bc1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:44.542381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8024ea2d-5a36-4803-b4c9-eacb8a76977b req-0db10c80-c80b-43e1-9f00-8867c6093bcd service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:44.542914 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8024ea2d-5a36-4803-b4c9-eacb8a76977b req-0db10c80-c80b-43e1-9f00-8867c6093bcd service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:44.556470 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-8024ea2d-5a36-4803-b4c9-eacb8a76977b req-0db10c80-c80b-43e1-9f00-8867c6093bcd service nova] Creating event network-changed:d410a05b-4bb6-4dde-aed0-6560bd683bc1 for instance fd665a70-b047-4bf2-b775-2f93e1be084c on hv-cinder-82282 Jul 20 11:43:44.561730 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-8024ea2d-5a36-4803-b4c9-eacb8a76977b req-0db10c80-c80b-43e1-9f00-8867c6093bcd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033365 Jul 20 11:43:44.562796 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 435/854] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:54.017210 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=41 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:54.017947 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:54.022444 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cdb32933-5142-4a03-a6ff-b6b937b8aa89 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:54.023055 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cdb32933-5142-4a03-a6ff-b6b937b8aa89 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:54.029113 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdb32933-5142-4a03-a6ff-b6b937b8aa89 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:54.029558 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdb32933-5142-4a03-a6ff-b6b937b8aa89 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:54.030316 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdb32933-5142-4a03-a6ff-b6b937b8aa89 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:54.030752 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cdb32933-5142-4a03-a6ff-b6b937b8aa89 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:54.110321 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-cdb32933-5142-4a03-a6ff-b6b937b8aa89 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lazy-loading 'services' on Instance uuid 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:43:54.166506 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bf3a154e-3dc0-4133-8c24-3701d993ba93 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:54.167117 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bf3a154e-3dc0-4133-8c24-3701d993ba93 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:54.173267 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf3a154e-3dc0-4133-8c24-3701d993ba93 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:54.173707 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf3a154e-3dc0-4133-8c24-3701d993ba93 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:54.174456 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf3a154e-3dc0-4133-8c24-3701d993ba93 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:54.174884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf3a154e-3dc0-4133-8c24-3701d993ba93 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:54.196896 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-bf3a154e-3dc0-4133-8c24-3701d993ba93 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lazy-loading 'flavor' on Instance uuid 1eed301b-e35c-451d-931b-d25233e890f7 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:43:54.388962 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cdb32933-5142-4a03-a6ff-b6b937b8aa89 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "DELETE /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-volume_attachments/ce74fc08-4dfb-45ff-b938-25c7c8148369" status: 202 len: 0 microversion: 2.1 time: 0.372849 Jul 20 11:43:54.389844 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 420/855] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 11:43:54 2022] DELETE /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-volume_attachments/ce74fc08-4dfb-45ff-b938-25c7c8148369 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:43:54.399253 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e7ee4856-5b37-4f57-a899-54a6f2d8d471 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:54.400315 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e7ee4856-5b37-4f57-a899-54a6f2d8d471 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:54.406896 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7ee4856-5b37-4f57-a899-54a6f2d8d471 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:54.407368 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7ee4856-5b37-4f57-a899-54a6f2d8d471 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:54.408139 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7ee4856-5b37-4f57-a899-54a6f2d8d471 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:54.408657 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e7ee4856-5b37-4f57-a899-54a6f2d8d471 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:54.441521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e7ee4856-5b37-4f57-a899-54a6f2d8d471 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047242 Jul 20 11:43:54.443280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 421/856] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:43:54 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:54.546728 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:54.556526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bf3a154e-3dc0-4133-8c24-3701d993ba93 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "POST /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7/action" status: 202 len: 0 microversion: 2.1 time: 0.394910 Jul 20 11:43:54.557147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 436/857] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:43:54 2022] POST /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:43:54.565382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5ef6bf7c-f272-4578-ad35-c9835cecc285 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:54.566172 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5ef6bf7c-f272-4578-ad35-c9835cecc285 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:54.573193 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ef6bf7c-f272-4578-ad35-c9835cecc285 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:54.576670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ef6bf7c-f272-4578-ad35-c9835cecc285 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:54.576670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ef6bf7c-f272-4578-ad35-c9835cecc285 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:54.576670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5ef6bf7c-f272-4578-ad35-c9835cecc285 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:54.708629 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5ef6bf7c-f272-4578-ad35-c9835cecc285 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:54.716595 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5ef6bf7c-f272-4578-ad35-c9835cecc285 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.155131 Jul 20 11:43:54.717189 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 422/858] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:54 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:55.457910 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-699b37c6-9a22-43cd-95e8-e0f98f5236ba tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:55.459333 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-699b37c6-9a22-43cd-95e8-e0f98f5236ba tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:55.466313 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-699b37c6-9a22-43cd-95e8-e0f98f5236ba tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:55.466762 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-699b37c6-9a22-43cd-95e8-e0f98f5236ba tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:55.467533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-699b37c6-9a22-43cd-95e8-e0f98f5236ba tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:55.467974 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-699b37c6-9a22-43cd-95e8-e0f98f5236ba tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:55.497406 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-699b37c6-9a22-43cd-95e8-e0f98f5236ba tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044254 Jul 20 11:43:55.497963 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 437/859] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:43:55 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:55.733528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-739c77ce-2812-4f70-96b1-a6b7734404bc tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:55.734132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-739c77ce-2812-4f70-96b1-a6b7734404bc tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:55.740399 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-739c77ce-2812-4f70-96b1-a6b7734404bc tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:55.740877 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-739c77ce-2812-4f70-96b1-a6b7734404bc tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:55.741636 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-739c77ce-2812-4f70-96b1-a6b7734404bc tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:55.742061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-739c77ce-2812-4f70-96b1-a6b7734404bc tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:55.875580 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-739c77ce-2812-4f70-96b1-a6b7734404bc tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:55.883624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-739c77ce-2812-4f70-96b1-a6b7734404bc tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.153946 Jul 20 11:43:55.884178 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 423/860] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:55 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:56.509121 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-77c7e5ab-53e9-4c07-b48c-146d592939ac tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:56.510031 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-77c7e5ab-53e9-4c07-b48c-146d592939ac tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:56.517058 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77c7e5ab-53e9-4c07-b48c-146d592939ac tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:56.517511 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77c7e5ab-53e9-4c07-b48c-146d592939ac tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:56.518274 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77c7e5ab-53e9-4c07-b48c-146d592939ac tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:56.518711 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-77c7e5ab-53e9-4c07-b48c-146d592939ac tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:56.546855 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-77c7e5ab-53e9-4c07-b48c-146d592939ac tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041857 Jul 20 11:43:56.547401 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 438/861] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:43:56 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:43:56.619243 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f5954cff-a2fe-48e6-88f2-ebdeef579005 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:56.619730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f5954cff-a2fe-48e6-88f2-ebdeef579005 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:56.625647 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5954cff-a2fe-48e6-88f2-ebdeef579005 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:56.626088 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5954cff-a2fe-48e6-88f2-ebdeef579005 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:56.626840 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5954cff-a2fe-48e6-88f2-ebdeef579005 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:56.627268 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f5954cff-a2fe-48e6-88f2-ebdeef579005 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:56.650987 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f5954cff-a2fe-48e6-88f2-ebdeef579005 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:43:56.901756 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ae71cd9f-2a3d-46f0-a620-274f88e23308 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:56.902493 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ae71cd9f-2a3d-46f0-a620-274f88e23308 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:56.908771 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae71cd9f-2a3d-46f0-a620-274f88e23308 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:56.909245 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae71cd9f-2a3d-46f0-a620-274f88e23308 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:56.910008 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae71cd9f-2a3d-46f0-a620-274f88e23308 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:56.910455 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae71cd9f-2a3d-46f0-a620-274f88e23308 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:56.911246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f5954cff-a2fe-48e6-88f2-ebdeef579005 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "DELETE /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 204 len: 0 microversion: 2.1 time: 0.295958 Jul 20 11:43:56.913313 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 424/862] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:43:56 2022] DELETE /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:43:56.921611 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0e8b9a39-1db4-46ff-b50d-ae80ff92b76e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:56.922244 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0e8b9a39-1db4-46ff-b50d-ae80ff92b76e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:56.928085 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e8b9a39-1db4-46ff-b50d-ae80ff92b76e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:56.928519 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e8b9a39-1db4-46ff-b50d-ae80ff92b76e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:56.929309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e8b9a39-1db4-46ff-b50d-ae80ff92b76e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:56.929744 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e8b9a39-1db4-46ff-b50d-ae80ff92b76e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:57.113065 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae71cd9f-2a3d-46f0-a620-274f88e23308 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:57.122126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ae71cd9f-2a3d-46f0-a620-274f88e23308 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.225640 Jul 20 11:43:57.122805 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 439/863] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:56 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:57.130490 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0e8b9a39-1db4-46ff-b50d-ae80ff92b76e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:57.138871 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0e8b9a39-1db4-46ff-b50d-ae80ff92b76e tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1689 microversion: 2.1 time: 0.221356 Jul 20 11:43:57.139449 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 425/864] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:56 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1689 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:58.139705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-66599254-6ad9-46b3-8cf6-b621abaa5ef5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:58.140312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-66599254-6ad9-46b3-8cf6-b621abaa5ef5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:58.148122 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66599254-6ad9-46b3-8cf6-b621abaa5ef5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:58.148847 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66599254-6ad9-46b3-8cf6-b621abaa5ef5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:58.149621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66599254-6ad9-46b3-8cf6-b621abaa5ef5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:58.150142 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66599254-6ad9-46b3-8cf6-b621abaa5ef5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:58.156818 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e292c2a-99e2-40cc-a745-50b7e1715568 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:58.157492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2e292c2a-99e2-40cc-a745-50b7e1715568 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:58.163957 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e292c2a-99e2-40cc-a745-50b7e1715568 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:58.164402 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e292c2a-99e2-40cc-a745-50b7e1715568 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:58.165320 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e292c2a-99e2-40cc-a745-50b7e1715568 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:58.165751 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2e292c2a-99e2-40cc-a745-50b7e1715568 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:58.370326 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-66599254-6ad9-46b3-8cf6-b621abaa5ef5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:58.374582 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2e292c2a-99e2-40cc-a745-50b7e1715568 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:58.378019 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-66599254-6ad9-46b3-8cf6-b621abaa5ef5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.242135 Jul 20 11:43:58.378588 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 440/865] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:58 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:58.386507 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2e292c2a-99e2-40cc-a745-50b7e1715568 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1689 microversion: 2.1 time: 0.233744 Jul 20 11:43:58.387100 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 426/866] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:58 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1689 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:59.399927 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c53f44d4-574a-4e0d-814f-2cda9b0c0015 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:59.400531 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c53f44d4-574a-4e0d-814f-2cda9b0c0015 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:59.403232 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ce42df53-5727-4366-af5b-272b8ac3de43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:59.403839 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ce42df53-5727-4366-af5b-272b8ac3de43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:59.407025 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c53f44d4-574a-4e0d-814f-2cda9b0c0015 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:59.407470 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c53f44d4-574a-4e0d-814f-2cda9b0c0015 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:59.408229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c53f44d4-574a-4e0d-814f-2cda9b0c0015 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:59.408770 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c53f44d4-574a-4e0d-814f-2cda9b0c0015 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:59.410256 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce42df53-5727-4366-af5b-272b8ac3de43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:59.410699 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce42df53-5727-4366-af5b-272b8ac3de43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:59.411460 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce42df53-5727-4366-af5b-272b8ac3de43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:59.411891 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ce42df53-5727-4366-af5b-272b8ac3de43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:59.604437 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c53f44d4-574a-4e0d-814f-2cda9b0c0015 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:59.608029 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ce42df53-5727-4366-af5b-272b8ac3de43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:59.612327 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c53f44d4-574a-4e0d-814f-2cda9b0c0015 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.217214 Jul 20 11:43:59.612915 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 441/867] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:59 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:59.615487 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ce42df53-5727-4366-af5b-272b8ac3de43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1689 microversion: 2.1 time: 0.216014 Jul 20 11:43:59.616181 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 427/868] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:59 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1689 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:44:00.629229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4971e01c-4e4e-482e-86b6-06d3093ce634 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:00.629833 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4971e01c-4e4e-482e-86b6-06d3093ce634 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:00.632338 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7d82442d-7040-4b90-b936-f37e5e25fb50 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:00.632980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7d82442d-7040-4b90-b936-f37e5e25fb50 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:00.636445 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4971e01c-4e4e-482e-86b6-06d3093ce634 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:00.636918 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4971e01c-4e4e-482e-86b6-06d3093ce634 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:00.637768 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4971e01c-4e4e-482e-86b6-06d3093ce634 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:00.638204 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4971e01c-4e4e-482e-86b6-06d3093ce634 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:00.639495 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d82442d-7040-4b90-b936-f37e5e25fb50 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:00.639943 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d82442d-7040-4b90-b936-f37e5e25fb50 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:00.640715 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d82442d-7040-4b90-b936-f37e5e25fb50 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:00.641172 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d82442d-7040-4b90-b936-f37e5e25fb50 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:00.836398 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4971e01c-4e4e-482e-86b6-06d3093ce634 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:00.839313 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7d82442d-7040-4b90-b936-f37e5e25fb50 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:00.844066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4971e01c-4e4e-482e-86b6-06d3093ce634 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.218702 Jul 20 11:44:00.844823 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 442/869] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:00 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:00.847373 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7d82442d-7040-4b90-b936-f37e5e25fb50 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1689 microversion: 2.1 time: 0.218853 Jul 20 11:44:00.847938 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 428/870] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:00 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1689 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:44:01.873890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5178cb9c-c176-4da2-b8ad-7d45d02dd5e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:01.874509 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5178cb9c-c176-4da2-b8ad-7d45d02dd5e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:01.877694 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1d82698a-b5d7-4396-9f30-2aac20bb9dce tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:01.878313 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1d82698a-b5d7-4396-9f30-2aac20bb9dce tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:01.886071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5178cb9c-c176-4da2-b8ad-7d45d02dd5e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:01.886498 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d82698a-b5d7-4396-9f30-2aac20bb9dce tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:01.886689 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5178cb9c-c176-4da2-b8ad-7d45d02dd5e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:01.886997 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d82698a-b5d7-4396-9f30-2aac20bb9dce tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:01.887568 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5178cb9c-c176-4da2-b8ad-7d45d02dd5e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:01.887775 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d82698a-b5d7-4396-9f30-2aac20bb9dce tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:01.888143 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5178cb9c-c176-4da2-b8ad-7d45d02dd5e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:01.888248 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1d82698a-b5d7-4396-9f30-2aac20bb9dce tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:02.089271 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1d82698a-b5d7-4396-9f30-2aac20bb9dce tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:02.097236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1d82698a-b5d7-4396-9f30-2aac20bb9dce tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.232177 Jul 20 11:44:02.097754 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 443/871] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:01 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:02.103368 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5178cb9c-c176-4da2-b8ad-7d45d02dd5e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:02.115326 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5178cb9c-c176-4da2-b8ad-7d45d02dd5e8 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1689 microversion: 2.1 time: 0.245190 Jul 20 11:44:02.124946 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 429/872] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:01 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1689 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:02.364010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-aba989a9-ba3e-463b-b919-fb3cbd0332fb req-0e1af54e-2fe0-4924-80d9-0242019761f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78cd1446-9e8f-4683-8f7f-1be9fff0bc94", "name": "network-vif-deleted", "tag": "f6467344-0b58-4e3a-9d8a-0f4ddb0d4cb1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:02.371979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-aba989a9-ba3e-463b-b919-fb3cbd0332fb req-0e1af54e-2fe0-4924-80d9-0242019761f7 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:02.374113 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-aba989a9-ba3e-463b-b919-fb3cbd0332fb req-0e1af54e-2fe0-4924-80d9-0242019761f7 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:02.383560 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-aba989a9-ba3e-463b-b919-fb3cbd0332fb req-0e1af54e-2fe0-4924-80d9-0242019761f7 service nova] Creating event network-vif-deleted:f6467344-0b58-4e3a-9d8a-0f4ddb0d4cb1 for instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 on hv-cinder-82282 Jul 20 11:44:02.388571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-aba989a9-ba3e-463b-b919-fb3cbd0332fb req-0e1af54e-2fe0-4924-80d9-0242019761f7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028240 Jul 20 11:44:02.389459 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 444/873] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:44:03.114479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c18b0cec-f748-4836-a9b5-fd2f770ff103 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:03.115092 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c18b0cec-f748-4836-a9b5-fd2f770ff103 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:03.122175 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c18b0cec-f748-4836-a9b5-fd2f770ff103 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:03.122599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c18b0cec-f748-4836-a9b5-fd2f770ff103 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:03.123407 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c18b0cec-f748-4836-a9b5-fd2f770ff103 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:03.123844 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c18b0cec-f748-4836-a9b5-fd2f770ff103 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:03.134586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5e663505-ef5f-4c3f-88fb-dfc1b78da8d2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:03.135947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5e663505-ef5f-4c3f-88fb-dfc1b78da8d2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:03.142563 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e663505-ef5f-4c3f-88fb-dfc1b78da8d2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:03.143300 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e663505-ef5f-4c3f-88fb-dfc1b78da8d2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:03.144337 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e663505-ef5f-4c3f-88fb-dfc1b78da8d2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:03.144878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e663505-ef5f-4c3f-88fb-dfc1b78da8d2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:03.175790 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e663505-ef5f-4c3f-88fb-dfc1b78da8d2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:03.176238 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5e663505-ef5f-4c3f-88fb-dfc1b78da8d2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:03.176677 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-5e663505-ef5f-4c3f-88fb-dfc1b78da8d2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lazy-loading 'fault' on Instance uuid 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:44:03.224055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5e663505-ef5f-4c3f-88fb-dfc1b78da8d2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:03.232230 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5e663505-ef5f-4c3f-88fb-dfc1b78da8d2 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 200 len: 1334 microversion: 2.1 time: 0.102267 Jul 20 11:44:03.232838 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 445/874] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:03 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:44:03.291327 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c18b0cec-f748-4836-a9b5-fd2f770ff103 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:03.299170 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c18b0cec-f748-4836-a9b5-fd2f770ff103 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.188418 Jul 20 11:44:03.299596 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 430/875] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:03 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:04.249204 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-670e57e4-c56a-473c-9395-35f351ae6ac4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:04.249814 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-670e57e4-c56a-473c-9395-35f351ae6ac4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 78cd1446-9e8f-4683-8f7f-1be9fff0bc94] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:04.252289 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=44 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:04.257020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-670e57e4-c56a-473c-9395-35f351ae6ac4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:04.257467 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-670e57e4-c56a-473c-9395-35f351ae6ac4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:04.258222 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-670e57e4-c56a-473c-9395-35f351ae6ac4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:04.258651 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-670e57e4-c56a-473c-9395-35f351ae6ac4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:04.271659 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-670e57e4-c56a-473c-9395-35f351ae6ac4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] HTTP exception thrown: Instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 could not be found. Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-670e57e4-c56a-473c-9395-35f351ae6ac4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Request method failure captured: Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 HTTP/1.1 Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-iAGi3InK9o5h93wuwA0y5ZKhv9_XAKhliB9WFK5RjT5ZrOF0JJYFYjtkeiIwNODHDo_KnrpGsMdR8pcBx5HCYKHdHD5VuyuH1iNl2gS4aXxblQodWvSpFJzhwU9a0ybd_eXdwbZ98_NuT-Y4ohecR6FqVlVYRBJMZgmzEOLlYCO8M Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: 9192fe06f92b47cfbc286bb76e97410b Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:44:04.274276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:44:04.276017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9192fe06f92b47cfbc286bb76e97410b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9192fe06f92b47cfbc286bb76e97410b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9192fe06f92b47cfbc286bb76e97410b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9192fe06f92b47cfbc286bb76e97410b"}]}] Jul 20 11:44:04.276017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:44:04.276017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 9192fe06f92b47cfbc286bb76e97410b Jul 20 11:44:04.276017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:44:04.276017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-260660390-project Jul 20 11:44:04.276017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:44:04.276017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:44:04.276017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 51876164aea741cc873ba4755e6c6fcd Jul 20 11:44:04.276017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-260660390-project Jul 20 11:44:04.276017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:44:04.276017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 could not be found. Jul 20 11:44:04.276017 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': '78cd1446-9e8f-4683-8f7f-1be9fff0bc94'} Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 could not be found. Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:44:04.277192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 could not be found. Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 could not be found. Jul 20 11:44:04.278492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:44:04.280146 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-670e57e4-c56a-473c-9395-35f351ae6ac4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Returning 404 to user: Instance 78cd1446-9e8f-4683-8f7f-1be9fff0bc94 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:44:04.280146 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-670e57e4-c56a-473c-9395-35f351ae6ac4 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94" status: 404 len: 111 microversion: 2.1 time: 0.030385 Jul 20 11:44:04.280146 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 446/876] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:04 2022] GET /compute/v2.1/servers/78cd1446-9e8f-4683-8f7f-1be9fff0bc94 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:44:04.284451 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2ed7d75b-2e18-45f0-9f22-2574da2fe702 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '.version_select at 0x7f44e00a1a60>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:04.315865 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-559f5200-8573-4a3d-b331-f932213cc117 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:04.316500 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-559f5200-8573-4a3d-b331-f932213cc117 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:04.322538 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-559f5200-8573-4a3d-b331-f932213cc117 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:04.327121 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-559f5200-8573-4a3d-b331-f932213cc117 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:04.327121 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-559f5200-8573-4a3d-b331-f932213cc117 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:04.327121 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-559f5200-8573-4a3d-b331-f932213cc117 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:04.367000 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2ed7d75b-2e18-45f0-9f22-2574da2fe702 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-313792322" status: 202 len: 0 microversion: 2.1 time: 0.086298 Jul 20 11:44:04.367577 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 431/877] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jul 20 11:44:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-313792322 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:44:04.456998 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-559f5200-8573-4a3d-b331-f932213cc117 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:04.465328 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-559f5200-8573-4a3d-b331-f932213cc117 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.153518 Jul 20 11:44:04.465890 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 447/878] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:04 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:44:05.483067 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-91dd304a-c91c-4e1f-8be2-be2108fc04e5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:05.483679 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-91dd304a-c91c-4e1f-8be2-be2108fc04e5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:05.491173 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91dd304a-c91c-4e1f-8be2-be2108fc04e5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:05.495084 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91dd304a-c91c-4e1f-8be2-be2108fc04e5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:05.495084 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91dd304a-c91c-4e1f-8be2-be2108fc04e5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:05.495084 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-91dd304a-c91c-4e1f-8be2-be2108fc04e5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:05.623439 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-91dd304a-c91c-4e1f-8be2-be2108fc04e5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:05.630915 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-91dd304a-c91c-4e1f-8be2-be2108fc04e5 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.151780 Jul 20 11:44:05.631994 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 432/879] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:05 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:06.647968 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3a1e3abc-3e6b-409f-b4e9-d0036af377b3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:06.648491 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3a1e3abc-3e6b-409f-b4e9-d0036af377b3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:06.655184 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a1e3abc-3e6b-409f-b4e9-d0036af377b3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:06.655633 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a1e3abc-3e6b-409f-b4e9-d0036af377b3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:06.656401 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a1e3abc-3e6b-409f-b4e9-d0036af377b3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:06.656868 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3a1e3abc-3e6b-409f-b4e9-d0036af377b3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:06.802079 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3a1e3abc-3e6b-409f-b4e9-d0036af377b3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:06.810082 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3a1e3abc-3e6b-409f-b4e9-d0036af377b3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.166155 Jul 20 11:44:06.810638 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 448/880] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:06 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:07.622918 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5bed9617-fed8-4381-ad1f-8c7fdd28eafa tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:07.623416 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5bed9617-fed8-4381-ad1f-8c7fdd28eafa tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:07.629641 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bed9617-fed8-4381-ad1f-8c7fdd28eafa tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:07.630087 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bed9617-fed8-4381-ad1f-8c7fdd28eafa tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:07.630844 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bed9617-fed8-4381-ad1f-8c7fdd28eafa tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:07.631284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bed9617-fed8-4381-ad1f-8c7fdd28eafa tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:07.655233 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5bed9617-fed8-4381-ad1f-8c7fdd28eafa tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:44:07.765592 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:07.827502 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d02f6bb9-aa2a-4437-954d-b107d7f1de99 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:07.828157 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d02f6bb9-aa2a-4437-954d-b107d7f1de99 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:07.834671 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d02f6bb9-aa2a-4437-954d-b107d7f1de99 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:07.835122 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d02f6bb9-aa2a-4437-954d-b107d7f1de99 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:07.835889 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d02f6bb9-aa2a-4437-954d-b107d7f1de99 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:07.836329 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d02f6bb9-aa2a-4437-954d-b107d7f1de99 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:07.948708 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5bed9617-fed8-4381-ad1f-8c7fdd28eafa tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 204 len: 0 microversion: 2.1 time: 0.329283 Jul 20 11:44:07.949353 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 433/881] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:44:07 2022] DELETE /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:44:07.957463 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f618806d-a657-45a4-a029-9eb492508679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:07.958151 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f618806d-a657-45a4-a029-9eb492508679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:07.965190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f618806d-a657-45a4-a029-9eb492508679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:07.969207 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f618806d-a657-45a4-a029-9eb492508679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:07.969207 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f618806d-a657-45a4-a029-9eb492508679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:07.969207 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f618806d-a657-45a4-a029-9eb492508679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:07.971902 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d02f6bb9-aa2a-4437-954d-b107d7f1de99 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:07.979969 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d02f6bb9-aa2a-4437-954d-b107d7f1de99 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.156342 Jul 20 11:44:07.980529 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 449/882] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:07 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:44:08.098588 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f618806d-a657-45a4-a029-9eb492508679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:08.106680 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f618806d-a657-45a4-a029-9eb492508679 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1509 microversion: 2.1 time: 0.153182 Jul 20 11:44:08.107240 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 434/883] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:07 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:44:08.996979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ede9eae8-7c41-4300-9cc3-9135ca451e2c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:08.997590 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ede9eae8-7c41-4300-9cc3-9135ca451e2c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:09.003976 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ede9eae8-7c41-4300-9cc3-9135ca451e2c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:09.004433 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ede9eae8-7c41-4300-9cc3-9135ca451e2c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:09.005205 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ede9eae8-7c41-4300-9cc3-9135ca451e2c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:09.005637 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ede9eae8-7c41-4300-9cc3-9135ca451e2c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:09.124323 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8cbca520-f131-473f-be3e-8eee04564327 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:09.124903 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8cbca520-f131-473f-be3e-8eee04564327 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:09.131847 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cbca520-f131-473f-be3e-8eee04564327 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:09.133350 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cbca520-f131-473f-be3e-8eee04564327 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:09.133922 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cbca520-f131-473f-be3e-8eee04564327 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:09.134440 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8cbca520-f131-473f-be3e-8eee04564327 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:09.154544 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ede9eae8-7c41-4300-9cc3-9135ca451e2c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:09.170338 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ede9eae8-7c41-4300-9cc3-9135ca451e2c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.177151 Jul 20 11:44:09.171125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 450/884] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:08 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:09.266680 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8cbca520-f131-473f-be3e-8eee04564327 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:09.274995 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8cbca520-f131-473f-be3e-8eee04564327 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1509 microversion: 2.1 time: 0.155349 Jul 20 11:44:09.296509 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 435/885] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:09 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:44:09.476853 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-46b835e2-59a5-4459-a9cf-0a26625750a8 req-c3b7e5e3-e4de-4339-b7d2-c66640457c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59b4f4f-d49c-4d6b-be00-331cddb9bfc2", "name": "network-vif-deleted", "tag": "ca7da8b0-f849-4241-9124-9a117850f9e8"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:09.485310 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-46b835e2-59a5-4459-a9cf-0a26625750a8 req-c3b7e5e3-e4de-4339-b7d2-c66640457c9c service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:09.485823 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-46b835e2-59a5-4459-a9cf-0a26625750a8 req-c3b7e5e3-e4de-4339-b7d2-c66640457c9c service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:09.497393 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-46b835e2-59a5-4459-a9cf-0a26625750a8 req-c3b7e5e3-e4de-4339-b7d2-c66640457c9c service nova] Creating event network-vif-deleted:ca7da8b0-f849-4241-9124-9a117850f9e8 for instance e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 on hv-cinder-82282 Jul 20 11:44:09.502319 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-46b835e2-59a5-4459-a9cf-0a26625750a8 req-c3b7e5e3-e4de-4339-b7d2-c66640457c9c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029152 Jul 20 11:44:09.502818 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 451/886] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:44:10.186628 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e3524855-e330-4431-94b3-b0b50d3af86e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:10.187231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e3524855-e330-4431-94b3-b0b50d3af86e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:10.193738 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3524855-e330-4431-94b3-b0b50d3af86e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:10.194176 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3524855-e330-4431-94b3-b0b50d3af86e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:10.194950 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3524855-e330-4431-94b3-b0b50d3af86e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:10.195374 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e3524855-e330-4431-94b3-b0b50d3af86e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:10.304283 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dab56399-b589-40e1-93fc-4275b0015276 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:10.305637 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dab56399-b589-40e1-93fc-4275b0015276 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:10.311938 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dab56399-b589-40e1-93fc-4275b0015276 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:10.312386 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dab56399-b589-40e1-93fc-4275b0015276 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:10.313193 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dab56399-b589-40e1-93fc-4275b0015276 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:10.313628 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dab56399-b589-40e1-93fc-4275b0015276 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:10.330034 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e3524855-e330-4431-94b3-b0b50d3af86e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:10.338182 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e3524855-e330-4431-94b3-b0b50d3af86e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.155594 Jul 20 11:44:10.340343 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 436/887] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:10 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:10.345266 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dab56399-b589-40e1-93fc-4275b0015276 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:10.345716 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dab56399-b589-40e1-93fc-4275b0015276 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:10.346299 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-dab56399-b589-40e1-93fc-4275b0015276 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lazy-loading 'fault' on Instance uuid e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:44:10.635662 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dab56399-b589-40e1-93fc-4275b0015276 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:10.644093 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dab56399-b589-40e1-93fc-4275b0015276 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 200 len: 1312 microversion: 2.1 time: 0.344407 Jul 20 11:44:10.644777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 452/888] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:10 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 1312 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:44:11.355199 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-57d78165-8250-4817-9dff-6939b52cf03d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:11.355815 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-57d78165-8250-4817-9dff-6939b52cf03d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:11.362303 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57d78165-8250-4817-9dff-6939b52cf03d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:11.362748 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57d78165-8250-4817-9dff-6939b52cf03d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:11.363528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57d78165-8250-4817-9dff-6939b52cf03d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:11.363954 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-57d78165-8250-4817-9dff-6939b52cf03d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:11.491730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-57d78165-8250-4817-9dff-6939b52cf03d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:11.499281 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-57d78165-8250-4817-9dff-6939b52cf03d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.147879 Jul 20 11:44:11.499790 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 437/889] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:11 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:11.660696 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-619ac5c4-17a8-423e-b838-265fe05d2c73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:11.661369 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-619ac5c4-17a8-423e-b838-265fe05d2c73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: e59b4f4f-d49c-4d6b-be00-331cddb9bfc2] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:11.667825 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-619ac5c4-17a8-423e-b838-265fe05d2c73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:11.668271 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-619ac5c4-17a8-423e-b838-265fe05d2c73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:11.669059 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-619ac5c4-17a8-423e-b838-265fe05d2c73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:11.669493 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-619ac5c4-17a8-423e-b838-265fe05d2c73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:11.682825 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-619ac5c4-17a8-423e-b838-265fe05d2c73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] HTTP exception thrown: Instance e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 could not be found. Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-619ac5c4-17a8-423e-b838-265fe05d2c73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Request method failure captured: Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 HTTP/1.1 Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-iAGi3InK9o5h93wuwA0y5ZKhv9_XAKhliB9WFK5RjT5ZrOF0JJYFYjtkeiIwNODHDo_KnrpGsMdR8pcBx5HCYKHdHD5VuyuH1iNl2gS4aXxblQodWvSpFJzhwU9a0ybd_eXdwbZ98_NuT-Y4ohecR6FqVlVYRBJMZgmzEOLlYCO8M Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: 9192fe06f92b47cfbc286bb76e97410b Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:44:11.684416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:44:11.686053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9192fe06f92b47cfbc286bb76e97410b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9192fe06f92b47cfbc286bb76e97410b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9192fe06f92b47cfbc286bb76e97410b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9192fe06f92b47cfbc286bb76e97410b"}]}] Jul 20 11:44:11.686053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:44:11.686053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 9192fe06f92b47cfbc286bb76e97410b Jul 20 11:44:11.686053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:44:11.686053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-ServerRescueNegativeTestJSON-260660390-project Jul 20 11:44:11.686053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:44:11.686053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:44:11.686053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 51876164aea741cc873ba4755e6c6fcd Jul 20 11:44:11.686053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-260660390-project Jul 20 11:44:11.686053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:44:11.686053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 could not be found. Jul 20 11:44:11.686053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'e59b4f4f-d49c-4d6b-be00-331cddb9bfc2'} Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 could not be found. Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:44:11.687054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 could not be found. Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 could not be found. Jul 20 11:44:11.688536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:44:11.690022 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-619ac5c4-17a8-423e-b838-265fe05d2c73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Returning 404 to user: Instance e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:44:11.690022 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-619ac5c4-17a8-423e-b838-265fe05d2c73 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2" status: 404 len: 111 microversion: 2.1 time: 0.028944 Jul 20 11:44:11.690022 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 453/890] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:11 2022] GET /compute/v2.1/servers/e59b4f4f-d49c-4d6b-be00-331cddb9bfc2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:44:11.694097 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d739ac41-be65-46c7-996b-d790d9b58c01 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:11.694592 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d739ac41-be65-46c7-996b-d790d9b58c01 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:11.701143 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d739ac41-be65-46c7-996b-d790d9b58c01 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:11.701593 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d739ac41-be65-46c7-996b-d790d9b58c01 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:11.702356 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d739ac41-be65-46c7-996b-d790d9b58c01 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:11.702786 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d739ac41-be65-46c7-996b-d790d9b58c01 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:11.726401 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d739ac41-be65-46c7-996b-d790d9b58c01 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:44:12.024950 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d739ac41-be65-46c7-996b-d790d9b58c01 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "DELETE /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 204 len: 0 microversion: 2.1 time: 0.334362 Jul 20 11:44:12.025534 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 438/891] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:44:11 2022] DELETE /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:44:12.033515 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-07aee094-1160-4034-9200-356a57092a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:12.034119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-07aee094-1160-4034-9200-356a57092a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:12.040161 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07aee094-1160-4034-9200-356a57092a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:12.040395 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07aee094-1160-4034-9200-356a57092a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:12.041176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07aee094-1160-4034-9200-356a57092a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:12.041614 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-07aee094-1160-4034-9200-356a57092a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:12.174309 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-07aee094-1160-4034-9200-356a57092a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:12.182593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-07aee094-1160-4034-9200-356a57092a5b tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.152732 Jul 20 11:44:12.189177 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 454/892] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:12 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:12.516530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-379b7b72-9f11-49c1-b352-0a65d547b45f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:12.517258 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-379b7b72-9f11-49c1-b352-0a65d547b45f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:12.524453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-379b7b72-9f11-49c1-b352-0a65d547b45f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:12.524931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-379b7b72-9f11-49c1-b352-0a65d547b45f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:12.525704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-379b7b72-9f11-49c1-b352-0a65d547b45f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:12.526140 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-379b7b72-9f11-49c1-b352-0a65d547b45f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:12.655359 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-379b7b72-9f11-49c1-b352-0a65d547b45f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:12.662821 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-379b7b72-9f11-49c1-b352-0a65d547b45f tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.150564 Jul 20 11:44:12.663386 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 439/893] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:12 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:13.200639 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2bc8c4f1-dab2-4895-93d6-4137955b8677 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:13.201285 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2bc8c4f1-dab2-4895-93d6-4137955b8677 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:13.207823 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bc8c4f1-dab2-4895-93d6-4137955b8677 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:13.208269 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bc8c4f1-dab2-4895-93d6-4137955b8677 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:13.209116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bc8c4f1-dab2-4895-93d6-4137955b8677 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:13.209549 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2bc8c4f1-dab2-4895-93d6-4137955b8677 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:13.226744 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:13.339171 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2bc8c4f1-dab2-4895-93d6-4137955b8677 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:13.346494 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2bc8c4f1-dab2-4895-93d6-4137955b8677 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1522 microversion: 2.1 time: 0.149981 Jul 20 11:44:13.347048 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 455/894] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:13 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:13.885461 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-90d713b9-5562-47ef-aae9-0841ed7324b1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:13.886076 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-90d713b9-5562-47ef-aae9-0841ed7324b1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:13.892084 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90d713b9-5562-47ef-aae9-0841ed7324b1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:13.892564 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90d713b9-5562-47ef-aae9-0841ed7324b1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:13.900931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90d713b9-5562-47ef-aae9-0841ed7324b1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:13.900931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-90d713b9-5562-47ef-aae9-0841ed7324b1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:14.014635 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-5831c818-4e84-423a-ac60-aa4acddfe552 req-817bfba6-d664-47b4-936f-1530d274fc2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c74b02-2e59-452e-9d39-949b9325a4e4", "name": "network-vif-deleted", "tag": "fa80c6ca-bceb-4f8e-a20a-e0d485f3c1d1"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:14.023663 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5831c818-4e84-423a-ac60-aa4acddfe552 req-817bfba6-d664-47b4-936f-1530d274fc2b service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:14.024367 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5831c818-4e84-423a-ac60-aa4acddfe552 req-817bfba6-d664-47b4-936f-1530d274fc2b service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:14.038405 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-5831c818-4e84-423a-ac60-aa4acddfe552 req-817bfba6-d664-47b4-936f-1530d274fc2b service nova] Creating event network-vif-deleted:fa80c6ca-bceb-4f8e-a20a-e0d485f3c1d1 for instance 67c74b02-2e59-452e-9d39-949b9325a4e4 on hv-cinder-82282 Jul 20 11:44:14.043942 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-5831c818-4e84-423a-ac60-aa4acddfe552 req-817bfba6-d664-47b4-936f-1530d274fc2b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032870 Jul 20 11:44:14.044535 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 456/895] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:44:14.052736 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-90d713b9-5562-47ef-aae9-0841ed7324b1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:14.060816 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-90d713b9-5562-47ef-aae9-0841ed7324b1 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.385253 Jul 20 11:44:14.061474 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 440/896] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:13 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:14.366013 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f501b243-8d8c-46e0-89bb-0e63e530ee43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:14.366746 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f501b243-8d8c-46e0-89bb-0e63e530ee43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:14.373868 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f501b243-8d8c-46e0-89bb-0e63e530ee43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:14.374401 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f501b243-8d8c-46e0-89bb-0e63e530ee43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:14.375172 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f501b243-8d8c-46e0-89bb-0e63e530ee43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:14.375603 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f501b243-8d8c-46e0-89bb-0e63e530ee43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:14.407719 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f501b243-8d8c-46e0-89bb-0e63e530ee43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:14.408160 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f501b243-8d8c-46e0-89bb-0e63e530ee43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:14.408620 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-f501b243-8d8c-46e0-89bb-0e63e530ee43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lazy-loading 'fault' on Instance uuid 67c74b02-2e59-452e-9d39-949b9325a4e4 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:44:14.449848 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f501b243-8d8c-46e0-89bb-0e63e530ee43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51876164aea741cc873ba4755e6c6fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9192fe06f92b47cfbc286bb76e97410b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:14.457387 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f501b243-8d8c-46e0-89bb-0e63e530ee43 tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 200 len: 1312 microversion: 2.1 time: 0.097353 Jul 20 11:44:14.457943 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 457/897] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:14 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:15.078000 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-938be8c5-3517-49d7-a91f-357032449e07 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:15.078547 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-938be8c5-3517-49d7-a91f-357032449e07 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:15.085097 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-938be8c5-3517-49d7-a91f-357032449e07 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:15.085666 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-938be8c5-3517-49d7-a91f-357032449e07 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:15.086424 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-938be8c5-3517-49d7-a91f-357032449e07 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:15.086855 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-938be8c5-3517-49d7-a91f-357032449e07 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:15.218509 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-938be8c5-3517-49d7-a91f-357032449e07 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:15.227147 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-938be8c5-3517-49d7-a91f-357032449e07 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1570 microversion: 2.1 time: 0.152322 Jul 20 11:44:15.228028 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 441/898] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:15 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:15.244828 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c6df04df-3896-492a-a6ac-70b57ab3194e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:15.245402 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c6df04df-3896-492a-a6ac-70b57ab3194e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:15.251391 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6df04df-3896-492a-a6ac-70b57ab3194e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:15.251847 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6df04df-3896-492a-a6ac-70b57ab3194e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:15.252608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6df04df-3896-492a-a6ac-70b57ab3194e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:15.253078 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c6df04df-3896-492a-a6ac-70b57ab3194e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:15.480366 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-13edfd33-d421-4599-b333-8d2219a25f9a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:15.481199 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-13edfd33-d421-4599-b333-8d2219a25f9a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] [instance: 67c74b02-2e59-452e-9d39-949b9325a4e4] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:15.484577 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c6df04df-3896-492a-a6ac-70b57ab3194e tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "POST /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7/action" status: 202 len: 0 microversion: 2.1 time: 0.243749 Jul 20 11:44:15.485858 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 458/899] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:44:15 2022] POST /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:44:15.488828 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13edfd33-d421-4599-b333-8d2219a25f9a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:15.488828 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13edfd33-d421-4599-b333-8d2219a25f9a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:15.489091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13edfd33-d421-4599-b333-8d2219a25f9a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:15.489523 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-13edfd33-d421-4599-b333-8d2219a25f9a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:15.495191 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-6c624c02-bf72-494f-9596-4e225d8a6f0c req-cfaa3aeb-ecf2-4b0b-a52f-03bb69e2593d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eed301b-e35c-451d-931b-d25233e890f7", "name": "network-vif-unplugged", "status": "completed", "tag": "4beedb58-67b0-40d2-ab20-ba7385d750c0"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:15.502880 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-6c624c02-bf72-494f-9596-4e225d8a6f0c req-cfaa3aeb-ecf2-4b0b-a52f-03bb69e2593d service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:15.503570 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-6c624c02-bf72-494f-9596-4e225d8a6f0c req-cfaa3aeb-ecf2-4b0b-a52f-03bb69e2593d service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:15.504474 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-13edfd33-d421-4599-b333-8d2219a25f9a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] HTTP exception thrown: Instance 67c74b02-2e59-452e-9d39-949b9325a4e4 could not be found. Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-13edfd33-d421-4599-b333-8d2219a25f9a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Request method failure captured: Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 HTTP/1.1 Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-iAGi3InK9o5h93wuwA0y5ZKhv9_XAKhliB9WFK5RjT5ZrOF0JJYFYjtkeiIwNODHDo_KnrpGsMdR8pcBx5HCYKHdHD5VuyuH1iNl2gS4aXxblQodWvSpFJzhwU9a0ybd_eXdwbZ98_NuT-Y4ohecR6FqVlVYRBJMZgmzEOLlYCO8M Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: 9192fe06f92b47cfbc286bb76e97410b Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:44:15.506306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:44:15.508367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9192fe06f92b47cfbc286bb76e97410b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9192fe06f92b47cfbc286bb76e97410b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9192fe06f92b47cfbc286bb76e97410b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9192fe06f92b47cfbc286bb76e97410b"}]}] Jul 20 11:44:15.508367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:44:15.508367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 9192fe06f92b47cfbc286bb76e97410b Jul 20 11:44:15.508367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-260660390 Jul 20 11:44:15.508367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-ServerRescueNegativeTestJSON-260660390-project Jul 20 11:44:15.508367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:44:15.508367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:44:15.508367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 51876164aea741cc873ba4755e6c6fcd Jul 20 11:44:15.508367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-ServerRescueNegativeTestJSON-260660390-project Jul 20 11:44:15.508367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:44:15.508367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance 67c74b02-2e59-452e-9d39-949b9325a4e4 could not be found. Jul 20 11:44:15.508367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': '67c74b02-2e59-452e-9d39-949b9325a4e4'} Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67c74b02-2e59-452e-9d39-949b9325a4e4 could not be found. Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:44:15.512930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67c74b02-2e59-452e-9d39-949b9325a4e4 could not be found. Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67c74b02-2e59-452e-9d39-949b9325a4e4 could not be found. Jul 20 11:44:15.514499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:44:15.515825 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-13edfd33-d421-4599-b333-8d2219a25f9a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] Returning 404 to user: Instance 67c74b02-2e59-452e-9d39-949b9325a4e4 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:44:15.515825 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-13edfd33-d421-4599-b333-8d2219a25f9a tempest-ServerRescueNegativeTestJSON-260660390 tempest-ServerRescueNegativeTestJSON-260660390-project] 10.222.0.43 "GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4" status: 404 len: 111 microversion: 2.1 time: 0.037564 Jul 20 11:44:15.515825 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 442/900] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:15 2022] GET /compute/v2.1/servers/67c74b02-2e59-452e-9d39-949b9325a4e4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:44:15.515825 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6756b96e-d711-4dfe-bdd5-490da034ebff tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:15.517160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6756b96e-d711-4dfe-bdd5-490da034ebff tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:15.523794 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6756b96e-d711-4dfe-bdd5-490da034ebff tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:15.524626 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6756b96e-d711-4dfe-bdd5-490da034ebff tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:15.525609 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6756b96e-d711-4dfe-bdd5-490da034ebff tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:15.526154 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6756b96e-d711-4dfe-bdd5-490da034ebff tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:15.526285 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-6c624c02-bf72-494f-9596-4e225d8a6f0c req-cfaa3aeb-ecf2-4b0b-a52f-03bb69e2593d service nova] Creating event network-vif-unplugged:4beedb58-67b0-40d2-ab20-ba7385d750c0 for instance 1eed301b-e35c-451d-931b-d25233e890f7 on hv-cinder-82282 Jul 20 11:44:15.531569 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-6c624c02-bf72-494f-9596-4e225d8a6f0c req-cfaa3aeb-ecf2-4b0b-a52f-03bb69e2593d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041219 Jul 20 11:44:15.532224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 459/901] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:44:15.694340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6756b96e-d711-4dfe-bdd5-490da034ebff tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:15.704304 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6756b96e-d711-4dfe-bdd5-490da034ebff tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1578 microversion: 2.1 time: 0.194558 Jul 20 11:44:15.705641 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 443/902] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:15 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1578 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:16.723182 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e3c5b51e-90cd-4899-b5a5-f6f4808cd95d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:16.724522 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e3c5b51e-90cd-4899-b5a5-f6f4808cd95d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:16.732127 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3c5b51e-90cd-4899-b5a5-f6f4808cd95d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:16.732972 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3c5b51e-90cd-4899-b5a5-f6f4808cd95d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:16.733678 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3c5b51e-90cd-4899-b5a5-f6f4808cd95d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:16.734108 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e3c5b51e-90cd-4899-b5a5-f6f4808cd95d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:16.961408 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e3c5b51e-90cd-4899-b5a5-f6f4808cd95d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:16.968828 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e3c5b51e-90cd-4899-b5a5-f6f4808cd95d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1520 microversion: 2.1 time: 0.250851 Jul 20 11:44:16.969397 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 460/903] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:16 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:17.986862 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9ca0e503-4c18-46fc-8ca3-149b8836f2d3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:17.987627 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9ca0e503-4c18-46fc-8ca3-149b8836f2d3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:17.995224 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ca0e503-4c18-46fc-8ca3-149b8836f2d3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:17.995669 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ca0e503-4c18-46fc-8ca3-149b8836f2d3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:17.996444 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ca0e503-4c18-46fc-8ca3-149b8836f2d3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:17.996908 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ca0e503-4c18-46fc-8ca3-149b8836f2d3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:18.186479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9ca0e503-4c18-46fc-8ca3-149b8836f2d3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:18.194120 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9ca0e503-4c18-46fc-8ca3-149b8836f2d3 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1520 microversion: 2.1 time: 0.211164 Jul 20 11:44:18.194737 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 444/904] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:17 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:19.211464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f2d660f8-8ab6-410e-8519-1455ae33c830 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:19.212941 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f2d660f8-8ab6-410e-8519-1455ae33c830 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:19.220024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d660f8-8ab6-410e-8519-1455ae33c830 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:19.220471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d660f8-8ab6-410e-8519-1455ae33c830 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:19.221273 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d660f8-8ab6-410e-8519-1455ae33c830 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:19.221712 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d660f8-8ab6-410e-8519-1455ae33c830 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:19.381463 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f2d660f8-8ab6-410e-8519-1455ae33c830 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:19.388992 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f2d660f8-8ab6-410e-8519-1455ae33c830 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1576 microversion: 2.1 time: 0.181874 Jul 20 11:44:19.389557 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 461/905] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:19 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:20.405900 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2ddaf74c-dc95-457d-8bc6-c2faae3fc60a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:20.406462 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2ddaf74c-dc95-457d-8bc6-c2faae3fc60a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:20.413000 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ddaf74c-dc95-457d-8bc6-c2faae3fc60a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:20.417388 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ddaf74c-dc95-457d-8bc6-c2faae3fc60a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:20.417388 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ddaf74c-dc95-457d-8bc6-c2faae3fc60a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:20.417388 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ddaf74c-dc95-457d-8bc6-c2faae3fc60a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:20.550661 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2ddaf74c-dc95-457d-8bc6-c2faae3fc60a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:20.560501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2ddaf74c-dc95-457d-8bc6-c2faae3fc60a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1576 microversion: 2.1 time: 0.158322 Jul 20 11:44:20.561239 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 445/906] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:20 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:21.578115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a81df17c-c591-4deb-91c4-d1194cb0e63c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:21.579151 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a81df17c-c591-4deb-91c4-d1194cb0e63c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:21.585651 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a81df17c-c591-4deb-91c4-d1194cb0e63c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:21.586097 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a81df17c-c591-4deb-91c4-d1194cb0e63c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:21.586854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a81df17c-c591-4deb-91c4-d1194cb0e63c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:21.587286 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a81df17c-c591-4deb-91c4-d1194cb0e63c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:21.719957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a81df17c-c591-4deb-91c4-d1194cb0e63c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:21.727481 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a81df17c-c591-4deb-91c4-d1194cb0e63c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1576 microversion: 2.1 time: 0.153216 Jul 20 11:44:21.728048 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 462/907] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:21 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:44:22.744577 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f8da8830-cff0-4d5e-bd4e-d7259545003b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:22.745406 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f8da8830-cff0-4d5e-bd4e-d7259545003b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:22.751939 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8da8830-cff0-4d5e-bd4e-d7259545003b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:22.752394 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8da8830-cff0-4d5e-bd4e-d7259545003b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:22.753197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8da8830-cff0-4d5e-bd4e-d7259545003b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:22.753636 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f8da8830-cff0-4d5e-bd4e-d7259545003b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:22.916324 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f8da8830-cff0-4d5e-bd4e-d7259545003b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:22.923928 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f8da8830-cff0-4d5e-bd4e-d7259545003b tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1576 microversion: 2.1 time: 0.183274 Jul 20 11:44:22.924494 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 446/908] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:22 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:23.941414 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0facf33c-fcce-4232-9cc3-0fa292f36d10 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:23.942189 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0facf33c-fcce-4232-9cc3-0fa292f36d10 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:23.949261 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0facf33c-fcce-4232-9cc3-0fa292f36d10 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:23.949846 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0facf33c-fcce-4232-9cc3-0fa292f36d10 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:23.950731 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0facf33c-fcce-4232-9cc3-0fa292f36d10 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:23.951394 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0facf33c-fcce-4232-9cc3-0fa292f36d10 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:24.108777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0facf33c-fcce-4232-9cc3-0fa292f36d10 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:24.116931 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0facf33c-fcce-4232-9cc3-0fa292f36d10 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1576 microversion: 2.1 time: 0.179300 Jul 20 11:44:24.119141 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 463/909] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:23 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:25.136658 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e5c972f1-106f-4dce-8a22-333213e6b338 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:25.137512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e5c972f1-106f-4dce-8a22-333213e6b338 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:25.140264 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:25.145236 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5c972f1-106f-4dce-8a22-333213e6b338 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:25.145688 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5c972f1-106f-4dce-8a22-333213e6b338 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:25.146471 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5c972f1-106f-4dce-8a22-333213e6b338 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:25.146910 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e5c972f1-106f-4dce-8a22-333213e6b338 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:25.561793 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e5c972f1-106f-4dce-8a22-333213e6b338 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:25.571341 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e5c972f1-106f-4dce-8a22-333213e6b338 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1576 microversion: 2.1 time: 0.440489 Jul 20 11:44:25.572190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 447/910] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:25 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1576 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:26.591868 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ce3c9151-5415-4112-8b88-497970897234 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:26.592652 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ce3c9151-5415-4112-8b88-497970897234 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:26.599673 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce3c9151-5415-4112-8b88-497970897234 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:26.600107 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce3c9151-5415-4112-8b88-497970897234 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:26.601619 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce3c9151-5415-4112-8b88-497970897234 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:26.602134 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce3c9151-5415-4112-8b88-497970897234 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:26.729569 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba4f05f8-e77e-4957-9c0e-1b270402c30f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Action: 'create', calling method: .version_select at 0x7f44e00e11f0>, body: {"keypair": {"name": "tempest-keypair-224141810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrcRwiZd+oQzAsuSBrhYMamIcmc5p4AQ97r9pUKjgHmIa2VfkJAZrEFFBo6Nn/6UX+NAMqF1U52BZz3DjjWiptY39WB55ARFV6EURsaBk+HWv1lIghgoj0ypHTuytSF4Q=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:26.746406 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-ba4f05f8-e77e-4957-9c0e-1b270402c30f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Getting quotas for project 0eb934ac079d4a428bea92620e05280f. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:44:26.751170 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-ba4f05f8-e77e-4957-9c0e-1b270402c30f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Getting quotas for user 961ac5eb91a2432d971f4622620e4e1c and project 0eb934ac079d4a428bea92620e05280f. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:44:26.754496 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ce3c9151-5415-4112-8b88-497970897234 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:26.762749 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ce3c9151-5415-4112-8b88-497970897234 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1576 microversion: 2.1 time: 0.177068 Jul 20 11:44:26.763563 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 464/911] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:26 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:26.836177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba4f05f8-e77e-4957-9c0e-1b270402c30f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.242410 Jul 20 11:44:26.836932 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 448/912] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 11:44:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:44:27.780456 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ab337580-67fb-401d-bc1f-b338c8d70dea tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:27.785243 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ab337580-67fb-401d-bc1f-b338c8d70dea tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:27.787736 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab337580-67fb-401d-bc1f-b338c8d70dea tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:27.788190 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab337580-67fb-401d-bc1f-b338c8d70dea tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:27.789584 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab337580-67fb-401d-bc1f-b338c8d70dea tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:27.790022 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ab337580-67fb-401d-bc1f-b338c8d70dea tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:27.958665 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ab337580-67fb-401d-bc1f-b338c8d70dea tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:27.966723 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ab337580-67fb-401d-bc1f-b338c8d70dea tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1576 microversion: 2.1 time: 0.190416 Jul 20 11:44:27.967283 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 465/913] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:27 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:28.984459 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-047ecda1-c409-44d0-986a-2fb3e54667cf tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:28.986059 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-047ecda1-c409-44d0-986a-2fb3e54667cf tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:29.000252 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-047ecda1-c409-44d0-986a-2fb3e54667cf tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:29.000252 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-047ecda1-c409-44d0-986a-2fb3e54667cf tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:29.000252 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-047ecda1-c409-44d0-986a-2fb3e54667cf tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:29.000252 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-047ecda1-c409-44d0-986a-2fb3e54667cf tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:29.214605 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-047ecda1-c409-44d0-986a-2fb3e54667cf tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:29.224588 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-047ecda1-c409-44d0-986a-2fb3e54667cf tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1576 microversion: 2.1 time: 0.244706 Jul 20 11:44:29.265861 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 449/914] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:28 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1576 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:29.583292 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1158689236", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05811bd0-6102-4834-ad70-2ad3a86bc895"}], "security_groups": [{"name": "tempest-securitygroup--465195938"}], "key_name": "tempest-keypair-224141810", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:29.691658 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] validate_networks() for [('05811bd0-6102-4834-ad70-2ad3a86bc895', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:44:29.864172 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-97d0e83d-094c-472c-aeac-9fcbb63f5e4a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:29.864172 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-97d0e83d-094c-472c-aeac-9fcbb63f5e4a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:29.880929 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97d0e83d-094c-472c-aeac-9fcbb63f5e4a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:29.881597 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97d0e83d-094c-472c-aeac-9fcbb63f5e4a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:29.882590 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97d0e83d-094c-472c-aeac-9fcbb63f5e4a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:29.883398 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-97d0e83d-094c-472c-aeac-9fcbb63f5e4a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:29.887674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:29.916143 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-97d0e83d-094c-472c-aeac-9fcbb63f5e4a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments/63da3e7c-cb46-4960-96aa-a576696c7ee4" status: 200 len: 194 microversion: 2.20 time: 0.059939 Jul 20 11:44:29.921884 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 450/915] 10.222.0.43 () {60 vars in 1453 bytes} [Wed Jul 20 11:44:29 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments/63da3e7c-cb46-4960-96aa-a576696c7ee4 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:44:29.926901 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-7f6eee51-e4a9-40bd-9a22-5d2f3ab2ab5d req-e851379d-5b0f-437b-8639-6a0319bb9891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eed301b-e35c-451d-931b-d25233e890f7", "name": "network-vif-plugged", "status": "completed", "tag": "4beedb58-67b0-40d2-ab20-ba7385d750c0"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:29.936732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-7f6eee51-e4a9-40bd-9a22-5d2f3ab2ab5d req-e851379d-5b0f-437b-8639-6a0319bb9891 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:29.936732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-7f6eee51-e4a9-40bd-9a22-5d2f3ab2ab5d req-e851379d-5b0f-437b-8639-6a0319bb9891 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:29.948003 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-7f6eee51-e4a9-40bd-9a22-5d2f3ab2ab5d req-e851379d-5b0f-437b-8639-6a0319bb9891 service nova] Creating event network-vif-plugged:4beedb58-67b0-40d2-ab20-ba7385d750c0 for instance 1eed301b-e35c-451d-931b-d25233e890f7 on hv-cinder-82282 Jul 20 11:44:29.953867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-7f6eee51-e4a9-40bd-9a22-5d2f3ab2ab5d req-e851379d-5b0f-437b-8639-6a0319bb9891 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030389 Jul 20 11:44:29.955312 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 451/916] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:44:30.000701 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b17071c2-dfd4-4f55-baa4-15b841d0102a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:30.002204 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b17071c2-dfd4-4f55-baa4-15b841d0102a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:30.012051 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b17071c2-dfd4-4f55-baa4-15b841d0102a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:30.012915 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b17071c2-dfd4-4f55-baa4-15b841d0102a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:30.014406 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b17071c2-dfd4-4f55-baa4-15b841d0102a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:30.015071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b17071c2-dfd4-4f55-baa4-15b841d0102a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:30.129057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:44:30.129431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-b17071c2-dfd4-4f55-baa4-15b841d0102a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lazy-loading 'services' on Instance uuid ea3abfd3-22be-4728-9006-19ad38c1bd9c {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:44:30.129590 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:44:30.129975 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:44:30.133004 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:44:30.133725 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:44:30.150354 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:30.150815 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:30.151622 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:30.152233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:30.170992 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Getting quotas for project 0eb934ac079d4a428bea92620e05280f. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:44:30.180893 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Getting quotas for user 961ac5eb91a2432d971f4622620e4e1c and project 0eb934ac079d4a428bea92620e05280f. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:44:30.190779 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:44:30.193384 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:44:30.334106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-11793c43-99ae-4526-8186-b27c25d7dc1c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.755028 Jul 20 11:44:30.334931 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 466/917] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:44:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:44:30.340006 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dd25561b-6a51-491b-bc43-6de220dd111a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:30.340920 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dd25561b-6a51-491b-bc43-6de220dd111a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:30.365308 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd25561b-6a51-491b-bc43-6de220dd111a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:30.365766 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd25561b-6a51-491b-bc43-6de220dd111a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:30.371387 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd25561b-6a51-491b-bc43-6de220dd111a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:30.372346 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd25561b-6a51-491b-bc43-6de220dd111a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:30.389605 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b17071c2-dfd4-4f55-baa4-15b841d0102a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments/63da3e7c-cb46-4960-96aa-a576696c7ee4" status: 202 len: 0 microversion: 2.20 time: 0.393446 Jul 20 11:44:30.391114 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 452/918] 10.222.0.43 () {60 vars in 1456 bytes} [Wed Jul 20 11:44:29 2022] DELETE /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments/63da3e7c-cb46-4960-96aa-a576696c7ee4 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:44:30.403999 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6cafb8cd-ae71-4447-bb8c-bc4163c0622d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:30.405079 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6cafb8cd-ae71-4447-bb8c-bc4163c0622d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:30.510414 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6cafb8cd-ae71-4447-bb8c-bc4163c0622d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:30.531667 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6cafb8cd-ae71-4447-bb8c-bc4163c0622d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1237 microversion: 2.1 time: 0.137898 Jul 20 11:44:30.532251 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 453/919] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:30 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1237 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:30.546233 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-19ee6341-5fc0-4a2e-8ccb-5c8fac715185 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:30.547336 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19ee6341-5fc0-4a2e-8ccb-5c8fac715185 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:30.553982 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19ee6341-5fc0-4a2e-8ccb-5c8fac715185 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:30.555042 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19ee6341-5fc0-4a2e-8ccb-5c8fac715185 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:30.555826 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19ee6341-5fc0-4a2e-8ccb-5c8fac715185 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:30.556255 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19ee6341-5fc0-4a2e-8ccb-5c8fac715185 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:30.587420 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-19ee6341-5fc0-4a2e-8ccb-5c8fac715185 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053316 Jul 20 11:44:30.588076 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 454/920] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jul 20 11:44:30 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:44:30.595749 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dd25561b-6a51-491b-bc43-6de220dd111a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:30.603174 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dd25561b-6a51-491b-bc43-6de220dd111a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1576 microversion: 2.1 time: 0.266903 Jul 20 11:44:30.603725 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 467/921] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:30 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1576 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:31.549059 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-379bcfa1-7de0-44ce-ae6f-b191487f532f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:31.549684 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-379bcfa1-7de0-44ce-ae6f-b191487f532f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:31.599365 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-45afc6c8-59e2-46d0-8516-b0da3f81ca55 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:31.600411 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-45afc6c8-59e2-46d0-8516-b0da3f81ca55 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:31.602342 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-379bcfa1-7de0-44ce-ae6f-b191487f532f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:31.607179 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45afc6c8-59e2-46d0-8516-b0da3f81ca55 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:31.607641 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45afc6c8-59e2-46d0-8516-b0da3f81ca55 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:31.608416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45afc6c8-59e2-46d0-8516-b0da3f81ca55 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:31.608881 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-45afc6c8-59e2-46d0-8516-b0da3f81ca55 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:31.609005 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-379bcfa1-7de0-44ce-ae6f-b191487f532f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1237 microversion: 2.1 time: 0.064053 Jul 20 11:44:31.609579 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 455/922] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:31 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:31.622805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bd0ad342-8da4-4aeb-a91e-dba1b6d6958d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:31.623418 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bd0ad342-8da4-4aeb-a91e-dba1b6d6958d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:31.629788 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd0ad342-8da4-4aeb-a91e-dba1b6d6958d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:31.630238 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd0ad342-8da4-4aeb-a91e-dba1b6d6958d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:31.631013 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd0ad342-8da4-4aeb-a91e-dba1b6d6958d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:31.631452 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd0ad342-8da4-4aeb-a91e-dba1b6d6958d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:31.638493 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-45afc6c8-59e2-46d0-8516-b0da3f81ca55 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043096 Jul 20 11:44:31.639057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 468/923] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jul 20 11:44:31 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 11:44:31.764902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bd0ad342-8da4-4aeb-a91e-dba1b6d6958d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:31.772586 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bd0ad342-8da4-4aeb-a91e-dba1b6d6958d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1576 microversion: 2.1 time: 0.153475 Jul 20 11:44:31.773757 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 456/924] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:31 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:32.625502 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f2d86fa5-b25a-4ffa-be41-f36ce87c8d31 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:32.626116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f2d86fa5-b25a-4ffa-be41-f36ce87c8d31 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:32.632127 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d86fa5-b25a-4ffa-be41-f36ce87c8d31 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:32.632580 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d86fa5-b25a-4ffa-be41-f36ce87c8d31 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:32.633439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d86fa5-b25a-4ffa-be41-f36ce87c8d31 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:32.633880 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f2d86fa5-b25a-4ffa-be41-f36ce87c8d31 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:32.651078 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d0505e35-c747-4726-9c16-37b8ff32dd48 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:32.652044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d0505e35-c747-4726-9c16-37b8ff32dd48 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:32.658483 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0505e35-c747-4726-9c16-37b8ff32dd48 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:32.658939 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0505e35-c747-4726-9c16-37b8ff32dd48 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:32.659717 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0505e35-c747-4726-9c16-37b8ff32dd48 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:32.660157 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0505e35-c747-4726-9c16-37b8ff32dd48 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:32.690827 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d0505e35-c747-4726-9c16-37b8ff32dd48 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044025 Jul 20 11:44:32.691598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 457/925] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jul 20 11:44:32 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 11:44:32.695527 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f2d86fa5-b25a-4ffa-be41-f36ce87c8d31 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:32.703223 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f2d86fa5-b25a-4ffa-be41-f36ce87c8d31 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1233 microversion: 2.1 time: 0.081372 Jul 20 11:44:32.703721 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 469/926] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:32 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1233 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:32.790930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1ee818ec-90ec-475a-a16e-ecc830743adb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:32.791539 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1ee818ec-90ec-475a-a16e-ecc830743adb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:32.797489 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ee818ec-90ec-475a-a16e-ecc830743adb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:32.797937 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ee818ec-90ec-475a-a16e-ecc830743adb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:32.798698 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ee818ec-90ec-475a-a16e-ecc830743adb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:32.799130 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1ee818ec-90ec-475a-a16e-ecc830743adb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:32.931141 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1ee818ec-90ec-475a-a16e-ecc830743adb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:32.939786 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1ee818ec-90ec-475a-a16e-ecc830743adb tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1576 microversion: 2.1 time: 0.152446 Jul 20 11:44:32.940860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 458/927] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:32 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:33.703288 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a89ca8d5-4248-43e4-8217-6af55d7d7757 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:33.704218 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a89ca8d5-4248-43e4-8217-6af55d7d7757 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:33.710792 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a89ca8d5-4248-43e4-8217-6af55d7d7757 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:33.711244 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a89ca8d5-4248-43e4-8217-6af55d7d7757 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:33.712022 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a89ca8d5-4248-43e4-8217-6af55d7d7757 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:33.712450 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a89ca8d5-4248-43e4-8217-6af55d7d7757 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:33.720599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2b58bc80-4635-46da-95ff-9da4e661d046 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:33.721275 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2b58bc80-4635-46da-95ff-9da4e661d046 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:33.727765 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b58bc80-4635-46da-95ff-9da4e661d046 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:33.731968 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b58bc80-4635-46da-95ff-9da4e661d046 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:33.731968 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b58bc80-4635-46da-95ff-9da4e661d046 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:33.731968 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2b58bc80-4635-46da-95ff-9da4e661d046 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:33.742468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a89ca8d5-4248-43e4-8217-6af55d7d7757 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043511 Jul 20 11:44:33.743034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 470/928] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jul 20 11:44:33 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:33.793010 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2b58bc80-4635-46da-95ff-9da4e661d046 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:33.800493 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2b58bc80-4635-46da-95ff-9da4e661d046 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1289 microversion: 2.1 time: 0.083846 Jul 20 11:44:33.806496 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ed494d6e-1828-4816-b811-0cf69777e5b2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:33.806620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 459/929] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:33 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:44:33.806733 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ed494d6e-1828-4816-b811-0cf69777e5b2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:33.808376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed494d6e-1828-4816-b811-0cf69777e5b2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:33.808852 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed494d6e-1828-4816-b811-0cf69777e5b2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:33.809618 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed494d6e-1828-4816-b811-0cf69777e5b2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:33.810059 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed494d6e-1828-4816-b811-0cf69777e5b2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:33.834959 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ed494d6e-1828-4816-b811-0cf69777e5b2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:44:33.879298 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:33.959612 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6ab87fee-f3ca-47b1-85d6-d0a0158a2c0d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:33.960176 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6ab87fee-f3ca-47b1-85d6-d0a0158a2c0d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:33.966239 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ab87fee-f3ca-47b1-85d6-d0a0158a2c0d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:33.966682 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ab87fee-f3ca-47b1-85d6-d0a0158a2c0d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:33.967446 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ab87fee-f3ca-47b1-85d6-d0a0158a2c0d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:33.967879 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6ab87fee-f3ca-47b1-85d6-d0a0158a2c0d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:34.134374 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6ab87fee-f3ca-47b1-85d6-d0a0158a2c0d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:34.142303 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6ab87fee-f3ca-47b1-85d6-d0a0158a2c0d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1563 microversion: 2.1 time: 0.186683 Jul 20 11:44:34.142878 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 460/930] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:33 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1563 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:44:34.171822 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ed494d6e-1828-4816-b811-0cf69777e5b2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 204 len: 0 microversion: 2.20 time: 0.374352 Jul 20 11:44:34.172419 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 471/931] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jul 20 11:44:33 2022] DELETE /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 11:44:34.187013 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2bc21f9f-19b6-414b-8532-4a661585cc29 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:34.187752 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2bc21f9f-19b6-414b-8532-4a661585cc29 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:34.193754 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bc21f9f-19b6-414b-8532-4a661585cc29 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:34.194205 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bc21f9f-19b6-414b-8532-4a661585cc29 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:34.195015 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bc21f9f-19b6-414b-8532-4a661585cc29 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:34.195430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bc21f9f-19b6-414b-8532-4a661585cc29 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:34.336560 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2bc21f9f-19b6-414b-8532-4a661585cc29 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:34.344554 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2bc21f9f-19b6-414b-8532-4a661585cc29 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:34.346089 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2bc21f9f-19b6-414b-8532-4a661585cc29 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:34.347236 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2bc21f9f-19b6-414b-8532-4a661585cc29 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.164265 Jul 20 11:44:34.347800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 461/932] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:34 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:44:34.822525 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-70c6f671-e2ef-4822-b1b4-0fecbf9a2342 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:34.826696 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-70c6f671-e2ef-4822-b1b4-0fecbf9a2342 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:34.826696 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:34.830582 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-70c6f671-e2ef-4822-b1b4-0fecbf9a2342 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:34.831055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-70c6f671-e2ef-4822-b1b4-0fecbf9a2342 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:34.831869 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-70c6f671-e2ef-4822-b1b4-0fecbf9a2342 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:34.832305 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-70c6f671-e2ef-4822-b1b4-0fecbf9a2342 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:34.900425 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-70c6f671-e2ef-4822-b1b4-0fecbf9a2342 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:34.908348 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-70c6f671-e2ef-4822-b1b4-0fecbf9a2342 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1307 microversion: 2.1 time: 0.090601 Jul 20 11:44:34.912874 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 472/933] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:34 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:35.366594 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b7189869-10e8-4f61-99dc-4f29ddd28e30 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:35.367241 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b7189869-10e8-4f61-99dc-4f29ddd28e30 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:35.374492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7189869-10e8-4f61-99dc-4f29ddd28e30 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:35.374952 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7189869-10e8-4f61-99dc-4f29ddd28e30 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:35.375724 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7189869-10e8-4f61-99dc-4f29ddd28e30 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:35.376162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7189869-10e8-4f61-99dc-4f29ddd28e30 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:35.510102 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7189869-10e8-4f61-99dc-4f29ddd28e30 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:35.518504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7189869-10e8-4f61-99dc-4f29ddd28e30 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:35.519993 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7189869-10e8-4f61-99dc-4f29ddd28e30 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:35.521185 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b7189869-10e8-4f61-99dc-4f29ddd28e30 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.158592 Jul 20 11:44:35.521738 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 462/934] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:35 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:35.925030 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-01f21633-27e3-4fbd-9444-597d450f1ab7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:35.925591 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-01f21633-27e3-4fbd-9444-597d450f1ab7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:35.931784 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01f21633-27e3-4fbd-9444-597d450f1ab7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:35.932251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01f21633-27e3-4fbd-9444-597d450f1ab7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:35.933036 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01f21633-27e3-4fbd-9444-597d450f1ab7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:35.933470 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-01f21633-27e3-4fbd-9444-597d450f1ab7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:35.995013 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-01f21633-27e3-4fbd-9444-597d450f1ab7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:36.002527 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-01f21633-27e3-4fbd-9444-597d450f1ab7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1295 microversion: 2.1 time: 0.081901 Jul 20 11:44:36.003090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 473/935] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:35 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1295 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:36.539637 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c40d13f9-b55e-4e3a-bd95-12d4fb0274bd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:36.540422 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c40d13f9-b55e-4e3a-bd95-12d4fb0274bd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:36.547265 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c40d13f9-b55e-4e3a-bd95-12d4fb0274bd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:36.547740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c40d13f9-b55e-4e3a-bd95-12d4fb0274bd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:36.549383 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c40d13f9-b55e-4e3a-bd95-12d4fb0274bd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:36.549833 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c40d13f9-b55e-4e3a-bd95-12d4fb0274bd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:36.784905 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c40d13f9-b55e-4e3a-bd95-12d4fb0274bd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:36.793562 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c40d13f9-b55e-4e3a-bd95-12d4fb0274bd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:36.795156 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c40d13f9-b55e-4e3a-bd95-12d4fb0274bd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:36.796537 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c40d13f9-b55e-4e3a-bd95-12d4fb0274bd tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1724 microversion: 2.20 time: 0.260921 Jul 20 11:44:36.797392 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 463/936] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:36 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:37.019955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b0d6d77c-43b9-4679-9bfc-4e95324a10aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:37.020582 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b0d6d77c-43b9-4679-9bfc-4e95324a10aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:37.027673 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0d6d77c-43b9-4679-9bfc-4e95324a10aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:37.028134 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0d6d77c-43b9-4679-9bfc-4e95324a10aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:37.028979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0d6d77c-43b9-4679-9bfc-4e95324a10aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:37.029426 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b0d6d77c-43b9-4679-9bfc-4e95324a10aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:37.202993 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b0d6d77c-43b9-4679-9bfc-4e95324a10aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:37.216374 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b0d6d77c-43b9-4679-9bfc-4e95324a10aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1362 microversion: 2.1 time: 0.194693 Jul 20 11:44:37.216374 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 474/937] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:37 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:37.560526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-8dfe2c4c-fb28-4a0c-9e03-9fea52198b33 req-78381f22-a473-457d-af67-b0869cc8b093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3abfd3-22be-4728-9006-19ad38c1bd9c", "name": "network-vif-deleted", "tag": "e605e30c-d865-4978-9798-9dc53408552e"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:37.569293 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-8dfe2c4c-fb28-4a0c-9e03-9fea52198b33 req-78381f22-a473-457d-af67-b0869cc8b093 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:37.572604 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-8dfe2c4c-fb28-4a0c-9e03-9fea52198b33 req-78381f22-a473-457d-af67-b0869cc8b093 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:37.583629 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-8dfe2c4c-fb28-4a0c-9e03-9fea52198b33 req-78381f22-a473-457d-af67-b0869cc8b093 service nova] Creating event network-vif-deleted:e605e30c-d865-4978-9798-9dc53408552e for instance ea3abfd3-22be-4728-9006-19ad38c1bd9c on hv-cinder-82282 Jul 20 11:44:37.589746 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-8dfe2c4c-fb28-4a0c-9e03-9fea52198b33 req-78381f22-a473-457d-af67-b0869cc8b093 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032770 Jul 20 11:44:37.590805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 464/938] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:44:37.772358 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-8f0a5fb6-1ecf-4e42-915b-9a202849059b req-f916b81b-5caf-4abd-a51b-4ee6ea66e93a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a026878a-994a-4ce9-8c8c-550e0631ef69", "tag": "a6873909-d245-45e8-9730-87b2e3690590"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:37.791579 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8f0a5fb6-1ecf-4e42-915b-9a202849059b req-f916b81b-5caf-4abd-a51b-4ee6ea66e93a service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:37.792670 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8f0a5fb6-1ecf-4e42-915b-9a202849059b req-f916b81b-5caf-4abd-a51b-4ee6ea66e93a service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:37.813075 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-8f0a5fb6-1ecf-4e42-915b-9a202849059b req-f916b81b-5caf-4abd-a51b-4ee6ea66e93a service nova] Creating event network-changed:a6873909-d245-45e8-9730-87b2e3690590 for instance a026878a-994a-4ce9-8c8c-550e0631ef69 on hv-cinder-82282 Jul 20 11:44:37.818553 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-8f0a5fb6-1ecf-4e42-915b-9a202849059b req-f916b81b-5caf-4abd-a51b-4ee6ea66e93a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051550 Jul 20 11:44:37.819462 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 475/939] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:44:37.823713 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4eae610c-c800-4884-aed6-23f3461d48d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:37.824453 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4eae610c-c800-4884-aed6-23f3461d48d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:37.839629 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4eae610c-c800-4884-aed6-23f3461d48d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:37.840577 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4eae610c-c800-4884-aed6-23f3461d48d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:37.841707 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4eae610c-c800-4884-aed6-23f3461d48d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:37.842402 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4eae610c-c800-4884-aed6-23f3461d48d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:37.939434 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4eae610c-c800-4884-aed6-23f3461d48d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:37.951819 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4eae610c-c800-4884-aed6-23f3461d48d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:37.953623 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4eae610c-c800-4884-aed6-23f3461d48d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:37.955184 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4eae610c-c800-4884-aed6-23f3461d48d3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 200 len: 1367 microversion: 2.20 time: 0.142891 Jul 20 11:44:37.956311 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 465/940] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:37 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:38.233156 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-025c1f68-df73-46c1-be34-32e7d7b212aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:38.234000 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-025c1f68-df73-46c1-be34-32e7d7b212aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:38.242176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-025c1f68-df73-46c1-be34-32e7d7b212aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:38.243131 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-025c1f68-df73-46c1-be34-32e7d7b212aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:38.243908 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-025c1f68-df73-46c1-be34-32e7d7b212aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:38.244344 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-025c1f68-df73-46c1-be34-32e7d7b212aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:38.385637 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-025c1f68-df73-46c1-be34-32e7d7b212aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:38.395695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-025c1f68-df73-46c1-be34-32e7d7b212aa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1362 microversion: 2.1 time: 0.171341 Jul 20 11:44:38.396377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 476/941] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:38 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:38.973866 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-88f2ebdc-7755-4e54-830f-acb2832cd283 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:38.977865 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-88f2ebdc-7755-4e54-830f-acb2832cd283 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:38.981862 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88f2ebdc-7755-4e54-830f-acb2832cd283 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:38.982309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88f2ebdc-7755-4e54-830f-acb2832cd283 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:38.983080 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88f2ebdc-7755-4e54-830f-acb2832cd283 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:38.983511 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-88f2ebdc-7755-4e54-830f-acb2832cd283 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:38.996654 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-88f2ebdc-7755-4e54-830f-acb2832cd283 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] HTTP exception thrown: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-88f2ebdc-7755-4e54-830f-acb2832cd283 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Request method failure captured: Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c HTTP/1.1 Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-kS_vQtVu4snaDxMvygE0HlZPgOjAfKo4_fKXDnjjNWCDlymm9GFZqwbqnT2vcqIhfluadG17SISxptrQL_g4bHJj5wd1WOEVP_uIvRiiuF8jgL1DAcAbHX0D2Hz4A4GiIIgA1IQDS1QQHQ6AR1IW8imZsZdyZUT80V9FJFuvWEqIY Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: a18ce8b9ff3945ebbbf933d072515d53 Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:44:38.998352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:44:38.999902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a18ce8b9ff3945ebbbf933d072515d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a18ce8b9ff3945ebbbf933d072515d53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a18ce8b9ff3945ebbbf933d072515d53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a18ce8b9ff3945ebbbf933d072515d53"}]}] Jul 20 11:44:38.999902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:44:38.999902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: a18ce8b9ff3945ebbbf933d072515d53 Jul 20 11:44:38.999902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:44:38.999902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeShelveTestJSON-606311989-project Jul 20 11:44:38.999902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:44:38.999902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:44:38.999902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 63bd59ed8f4e4ae28253a9884b727c98 Jul 20 11:44:38.999902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeShelveTestJSON-606311989-project Jul 20 11:44:38.999902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:44:38.999902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:44:38.999902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'ea3abfd3-22be-4728-9006-19ad38c1bd9c'} Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:44:39.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:44:39.005693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:44:39.007142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-88f2ebdc-7755-4e54-830f-acb2832cd283 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Returning 404 to user: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:44:39.007142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-88f2ebdc-7755-4e54-830f-acb2832cd283 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 404 len: 111 microversion: 2.20 time: 0.029881 Jul 20 11:44:39.007142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 466/942] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:38 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:44:39.008765 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92c36ebf-a6fe-4e46-a3b4-e8a0d0106ebb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '.version_select at 0x7f44daeec160>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:39.104010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-92c36ebf-a6fe-4e46-a3b4-e8a0d0106ebb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1628550765" status: 204 len: 0 microversion: 2.20 time: 0.099132 Jul 20 11:44:39.104594 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 477/943] 10.222.0.43 () {60 vars in 1261 bytes} [Wed Jul 20 11:44:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1628550765 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:44:39.412434 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a4f0eac0-0bf8-4cb0-8946-bcd73ae6e10e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:39.413067 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a4f0eac0-0bf8-4cb0-8946-bcd73ae6e10e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:39.418978 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4f0eac0-0bf8-4cb0-8946-bcd73ae6e10e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:39.419422 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4f0eac0-0bf8-4cb0-8946-bcd73ae6e10e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:39.420192 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4f0eac0-0bf8-4cb0-8946-bcd73ae6e10e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:39.420626 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a4f0eac0-0bf8-4cb0-8946-bcd73ae6e10e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:39.552552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a4f0eac0-0bf8-4cb0-8946-bcd73ae6e10e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:39.569866 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a4f0eac0-0bf8-4cb0-8946-bcd73ae6e10e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1362 microversion: 2.1 time: 0.152048 Jul 20 11:44:39.569866 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 467/944] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:39 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:39.891677 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-68cf4348-5366-4b86-b2e8-8fcb6fa36781 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Action: 'create', calling method: .version_select at 0x7f44daec9790>, body: {"keypair": {"name": "tempest-keypair-1701889358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+ZBzvr3I6x6pcDhQ5BNxjg+uqyWD7OSu/AB/7li9M0I2Mw0we3DwsqSYFgYwmGF5gCHy4hpTM4Np31G5N9H4Y9qa+wh15E6PuxPdQ7BKlKniNYpXfQ4yf2lZkweTz5Kg=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:39.906038 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-68cf4348-5366-4b86-b2e8-8fcb6fa36781 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Getting quotas for project a18ce8b9ff3945ebbbf933d072515d53. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:44:39.909832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-68cf4348-5366-4b86-b2e8-8fcb6fa36781 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Getting quotas for user 63bd59ed8f4e4ae28253a9884b727c98 and project a18ce8b9ff3945ebbbf933d072515d53. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:44:39.995935 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-68cf4348-5366-4b86-b2e8-8fcb6fa36781 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.108226 Jul 20 11:44:39.996540 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 478/945] 10.222.0.43 () {62 vars in 1199 bytes} [Wed Jul 20 11:44:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 11:44:40.577762 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a15f706a-da97-482e-9bf6-889d680a3a50 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:40.578369 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a15f706a-da97-482e-9bf6-889d680a3a50 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:40.584901 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a15f706a-da97-482e-9bf6-889d680a3a50 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:40.585345 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a15f706a-da97-482e-9bf6-889d680a3a50 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:40.586774 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a15f706a-da97-482e-9bf6-889d680a3a50 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:40.587207 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a15f706a-da97-482e-9bf6-889d680a3a50 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:40.720140 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a15f706a-da97-482e-9bf6-889d680a3a50 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:40.727956 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a15f706a-da97-482e-9bf6-889d680a3a50 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1362 microversion: 2.1 time: 0.154107 Jul 20 11:44:40.730004 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 468/946] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:40 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:41.746109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:41.750359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c8f3ff9d-2765-401f-af73-e7a3d19a6c77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:41.750974 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c8f3ff9d-2765-401f-af73-e7a3d19a6c77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:41.759518 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8f3ff9d-2765-401f-af73-e7a3d19a6c77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:41.760070 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8f3ff9d-2765-401f-af73-e7a3d19a6c77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:41.760878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8f3ff9d-2765-401f-af73-e7a3d19a6c77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:41.761319 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c8f3ff9d-2765-401f-af73-e7a3d19a6c77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:41.918705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c8f3ff9d-2765-401f-af73-e7a3d19a6c77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:41.926751 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c8f3ff9d-2765-401f-af73-e7a3d19a6c77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1362 microversion: 2.1 time: 0.182236 Jul 20 11:44:41.933897 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 479/947] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:41 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:42.474361 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-514313587", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0be9d034-c901-4f78-8d6d-46cf0d873e8d"}], "security_groups": [{"name": "tempest-securitygroup--1258716852"}], "key_name": "tempest-keypair-1701889358", "user_data": "}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:42.483838 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:42.577285 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] validate_networks() for [('0be9d034-c901-4f78-8d6d-46cf0d873e8d', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:44:42.944247 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3229cd9b-ed23-4ac7-92a3-8bcc20372880 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:42.944828 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3229cd9b-ed23-4ac7-92a3-8bcc20372880 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:42.952331 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3229cd9b-ed23-4ac7-92a3-8bcc20372880 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:42.952775 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3229cd9b-ed23-4ac7-92a3-8bcc20372880 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:42.953580 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3229cd9b-ed23-4ac7-92a3-8bcc20372880 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:42.954016 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3229cd9b-ed23-4ac7-92a3-8bcc20372880 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:43.279257 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:44:43.279676 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:44:43.280143 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:44:43.280544 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:44:43.280984 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:44:43.289970 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:43.290411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:43.291197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:43.291625 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:43.308365 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Getting quotas for project a18ce8b9ff3945ebbbf933d072515d53. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:44:43.309396 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3229cd9b-ed23-4ac7-92a3-8bcc20372880 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:43.312385 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Getting quotas for user 63bd59ed8f4e4ae28253a9884b727c98 and project a18ce8b9ff3945ebbbf933d072515d53. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:44:43.317009 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3229cd9b-ed23-4ac7-92a3-8bcc20372880 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1362 microversion: 2.1 time: 0.377163 Jul 20 11:44:43.317669 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 480/948] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:42 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:44:43.328221 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:44:43.330685 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:44:43.527822 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4d34baab-b7d7-4ff9-ae0d-546ffa9af631 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.057850 Jul 20 11:44:43.528520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 469/949] 10.222.0.43 () {62 vars in 1187 bytes} [Wed Jul 20 11:44:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 11:44:43.538552 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eda6a785-74b7-4b3e-99a6-b99fff547b93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:43.539164 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eda6a785-74b7-4b3e-99a6-b99fff547b93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:43.591478 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eda6a785-74b7-4b3e-99a6-b99fff547b93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:43.598668 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eda6a785-74b7-4b3e-99a6-b99fff547b93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:43.600170 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eda6a785-74b7-4b3e-99a6-b99fff547b93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:43.601292 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eda6a785-74b7-4b3e-99a6-b99fff547b93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1281 microversion: 2.20 time: 0.066728 Jul 20 11:44:43.602173 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 481/950] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:43 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:44.029760 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-b5f5f62e-6e8e-4cf1-b367-0b312ecf952c req-398d216e-ecd6-4e74-91e0-3bb906990996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a026878a-994a-4ce9-8c8c-550e0631ef69", "name": "network-vif-plugged", "status": "completed", "tag": "a6873909-d245-45e8-9730-87b2e3690590"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:44.041272 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-b5f5f62e-6e8e-4cf1-b367-0b312ecf952c req-398d216e-ecd6-4e74-91e0-3bb906990996 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:44.041723 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-b5f5f62e-6e8e-4cf1-b367-0b312ecf952c req-398d216e-ecd6-4e74-91e0-3bb906990996 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:44.054242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-b5f5f62e-6e8e-4cf1-b367-0b312ecf952c req-398d216e-ecd6-4e74-91e0-3bb906990996 service nova] Creating event network-vif-plugged:a6873909-d245-45e8-9730-87b2e3690590 for instance a026878a-994a-4ce9-8c8c-550e0631ef69 on hv-cinder-82282 Jul 20 11:44:44.059430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-b5f5f62e-6e8e-4cf1-b367-0b312ecf952c req-398d216e-ecd6-4e74-91e0-3bb906990996 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034885 Jul 20 11:44:44.060138 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 470/951] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:44:44.334448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e0b533a8-5cc8-4b23-aa79-bea3f7130d3f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:44.335006 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e0b533a8-5cc8-4b23-aa79-bea3f7130d3f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:44.342214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0b533a8-5cc8-4b23-aa79-bea3f7130d3f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:44.342668 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0b533a8-5cc8-4b23-aa79-bea3f7130d3f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:44.343447 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0b533a8-5cc8-4b23-aa79-bea3f7130d3f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:44.343880 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0b533a8-5cc8-4b23-aa79-bea3f7130d3f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:44.480758 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e0b533a8-5cc8-4b23-aa79-bea3f7130d3f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:44.488217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e0b533a8-5cc8-4b23-aa79-bea3f7130d3f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1362 microversion: 2.1 time: 0.157765 Jul 20 11:44:44.488792 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 482/952] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:44 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:44.621095 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-22c6c7fc-80e2-4c22-a8f8-2b9aacfe76f5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:44.621706 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-22c6c7fc-80e2-4c22-a8f8-2b9aacfe76f5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:44.627919 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22c6c7fc-80e2-4c22-a8f8-2b9aacfe76f5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:44.628364 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22c6c7fc-80e2-4c22-a8f8-2b9aacfe76f5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:44.629169 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22c6c7fc-80e2-4c22-a8f8-2b9aacfe76f5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:44.629605 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-22c6c7fc-80e2-4c22-a8f8-2b9aacfe76f5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:44.649385 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:44.696048 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-22c6c7fc-80e2-4c22-a8f8-2b9aacfe76f5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:44.704748 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-22c6c7fc-80e2-4c22-a8f8-2b9aacfe76f5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:44.706284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-22c6c7fc-80e2-4c22-a8f8-2b9aacfe76f5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:44.707391 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-22c6c7fc-80e2-4c22-a8f8-2b9aacfe76f5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1285 microversion: 2.20 time: 0.091739 Jul 20 11:44:44.707943 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 471/953] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:44 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:45.504901 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-aee00aaf-7f1a-4171-9aae-e1d8ab71076f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:45.505526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-aee00aaf-7f1a-4171-9aae-e1d8ab71076f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:45.511942 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee00aaf-7f1a-4171-9aae-e1d8ab71076f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:45.512382 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee00aaf-7f1a-4171-9aae-e1d8ab71076f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:45.513165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee00aaf-7f1a-4171-9aae-e1d8ab71076f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:45.513595 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-aee00aaf-7f1a-4171-9aae-e1d8ab71076f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:45.639871 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-aee00aaf-7f1a-4171-9aae-e1d8ab71076f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:45.647223 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-aee00aaf-7f1a-4171-9aae-e1d8ab71076f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1362 microversion: 2.1 time: 0.146213 Jul 20 11:44:45.647774 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 483/954] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:45 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:45.725565 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3f9ccd74-217b-48e7-ab9c-527e64e9c256 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:45.726167 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3f9ccd74-217b-48e7-ab9c-527e64e9c256 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:45.733226 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f9ccd74-217b-48e7-ab9c-527e64e9c256 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:45.733669 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f9ccd74-217b-48e7-ab9c-527e64e9c256 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:45.734514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f9ccd74-217b-48e7-ab9c-527e64e9c256 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:45.734946 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3f9ccd74-217b-48e7-ab9c-527e64e9c256 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:45.795217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3f9ccd74-217b-48e7-ab9c-527e64e9c256 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:45.803092 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3f9ccd74-217b-48e7-ab9c-527e64e9c256 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:45.804589 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3f9ccd74-217b-48e7-ab9c-527e64e9c256 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:45.805738 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3f9ccd74-217b-48e7-ab9c-527e64e9c256 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1277 microversion: 2.20 time: 0.084442 Jul 20 11:44:45.806535 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 472/955] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:45 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:46.665078 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0e142718-6dc8-476e-899a-387ffb5bac34 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:46.665673 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0e142718-6dc8-476e-899a-387ffb5bac34 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:46.672115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e142718-6dc8-476e-899a-387ffb5bac34 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:46.676371 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e142718-6dc8-476e-899a-387ffb5bac34 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:46.676371 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e142718-6dc8-476e-899a-387ffb5bac34 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:46.676371 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0e142718-6dc8-476e-899a-387ffb5bac34 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:46.808541 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0e142718-6dc8-476e-899a-387ffb5bac34 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:46.815893 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0e142718-6dc8-476e-899a-387ffb5bac34 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1547 microversion: 2.1 time: 0.154751 Jul 20 11:44:46.816453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 484/956] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:44:46 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:44:46.824418 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c5a4fcf7-5f8d-4a19-a8ec-24762e9ba69b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:46.825063 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c5a4fcf7-5f8d-4a19-a8ec-24762e9ba69b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:46.831659 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5a4fcf7-5f8d-4a19-a8ec-24762e9ba69b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:46.832303 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5a4fcf7-5f8d-4a19-a8ec-24762e9ba69b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:46.833407 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5a4fcf7-5f8d-4a19-a8ec-24762e9ba69b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:46.833851 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c5a4fcf7-5f8d-4a19-a8ec-24762e9ba69b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:46.839002 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-def2c9d4-10e5-46d6-afcf-be32fa24f00a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:46.839496 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-def2c9d4-10e5-46d6-afcf-be32fa24f00a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:46.845594 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-def2c9d4-10e5-46d6-afcf-be32fa24f00a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:46.846038 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-def2c9d4-10e5-46d6-afcf-be32fa24f00a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:46.846994 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-def2c9d4-10e5-46d6-afcf-be32fa24f00a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:46.847432 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-def2c9d4-10e5-46d6-afcf-be32fa24f00a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:46.908983 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c5a4fcf7-5f8d-4a19-a8ec-24762e9ba69b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:46.916931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c5a4fcf7-5f8d-4a19-a8ec-24762e9ba69b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:46.918383 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c5a4fcf7-5f8d-4a19-a8ec-24762e9ba69b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:46.919492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c5a4fcf7-5f8d-4a19-a8ec-24762e9ba69b tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1341 microversion: 2.20 time: 0.099500 Jul 20 11:44:46.920036 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 473/957] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:46 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1341 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:46.942712 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-def2c9d4-10e5-46d6-afcf-be32fa24f00a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108254 Jul 20 11:44:46.943296 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 485/958] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 11:44:46 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:44:47.938274 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aafaf62a-d264-42f8-afbf-c50d9c3ed3cb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:47.938985 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aafaf62a-d264-42f8-afbf-c50d9c3ed3cb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:47.946933 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aafaf62a-d264-42f8-afbf-c50d9c3ed3cb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:47.947949 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aafaf62a-d264-42f8-afbf-c50d9c3ed3cb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:47.949051 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aafaf62a-d264-42f8-afbf-c50d9c3ed3cb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:47.949337 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aafaf62a-d264-42f8-afbf-c50d9c3ed3cb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:47.954317 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-36e09121-870e-4bf2-af71-f762873ce373 req-fdf65e22-8be9-4fe0-945a-eaf8205679ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a026878a-994a-4ce9-8c8c-550e0631ef69", "tag": "a6873909-d245-45e8-9730-87b2e3690590"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:47.962254 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-36e09121-870e-4bf2-af71-f762873ce373 req-fdf65e22-8be9-4fe0-945a-eaf8205679ac service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:47.962696 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-36e09121-870e-4bf2-af71-f762873ce373 req-fdf65e22-8be9-4fe0-945a-eaf8205679ac service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:47.974465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-36e09121-870e-4bf2-af71-f762873ce373 req-fdf65e22-8be9-4fe0-945a-eaf8205679ac service nova] Creating event network-changed:a6873909-d245-45e8-9730-87b2e3690590 for instance a026878a-994a-4ce9-8c8c-550e0631ef69 on hv-cinder-82282 Jul 20 11:44:47.983944 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-36e09121-870e-4bf2-af71-f762873ce373 req-fdf65e22-8be9-4fe0-945a-eaf8205679ac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029729 Jul 20 11:44:47.983944 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 486/959] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:44:48.235981 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aafaf62a-d264-42f8-afbf-c50d9c3ed3cb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:48.250162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aafaf62a-d264-42f8-afbf-c50d9c3ed3cb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:48.253801 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aafaf62a-d264-42f8-afbf-c50d9c3ed3cb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:48.254964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aafaf62a-d264-42f8-afbf-c50d9c3ed3cb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1407 microversion: 2.20 time: 0.320834 Jul 20 11:44:48.259149 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 474/960] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:47 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:49.033804 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-16d75e13-01d4-4282-89f8-11b0799a2e19 req-8dbfec50-9e67-4b05-b519-eaa69d16933a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e38ac977-daa5-4751-a9e8-12c27706032e", "tag": "98fc8e3d-93c5-45a0-9829-77da42ba8ac3"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:49.049430 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-16d75e13-01d4-4282-89f8-11b0799a2e19 req-8dbfec50-9e67-4b05-b519-eaa69d16933a service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:49.049878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-16d75e13-01d4-4282-89f8-11b0799a2e19 req-8dbfec50-9e67-4b05-b519-eaa69d16933a service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:49.062966 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-16d75e13-01d4-4282-89f8-11b0799a2e19 req-8dbfec50-9e67-4b05-b519-eaa69d16933a service nova] Creating event network-changed:98fc8e3d-93c5-45a0-9829-77da42ba8ac3 for instance e38ac977-daa5-4751-a9e8-12c27706032e on hv-cinder-82282 Jul 20 11:44:49.068688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-16d75e13-01d4-4282-89f8-11b0799a2e19 req-8dbfec50-9e67-4b05-b519-eaa69d16933a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039431 Jul 20 11:44:49.070077 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 487/961] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:44:49.279864 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bbf714b5-6765-43cd-821e-8c4508eb519c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:49.281469 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bbf714b5-6765-43cd-821e-8c4508eb519c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:49.288731 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbf714b5-6765-43cd-821e-8c4508eb519c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:49.289353 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbf714b5-6765-43cd-821e-8c4508eb519c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:49.290190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbf714b5-6765-43cd-821e-8c4508eb519c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:49.290705 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbf714b5-6765-43cd-821e-8c4508eb519c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:49.433853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bbf714b5-6765-43cd-821e-8c4508eb519c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:49.441756 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bbf714b5-6765-43cd-821e-8c4508eb519c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:49.443284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bbf714b5-6765-43cd-821e-8c4508eb519c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:49.444364 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bbf714b5-6765-43cd-821e-8c4508eb519c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1407 microversion: 2.20 time: 0.171441 Jul 20 11:44:49.444939 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 475/962] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:49 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:50.464350 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8803f8b4-a109-43cf-a66f-2b3fc5656e88 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:50.464991 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8803f8b4-a109-43cf-a66f-2b3fc5656e88 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:50.471123 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8803f8b4-a109-43cf-a66f-2b3fc5656e88 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:50.471566 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8803f8b4-a109-43cf-a66f-2b3fc5656e88 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:50.472326 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8803f8b4-a109-43cf-a66f-2b3fc5656e88 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:50.472760 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8803f8b4-a109-43cf-a66f-2b3fc5656e88 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:50.599000 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8803f8b4-a109-43cf-a66f-2b3fc5656e88 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:50.607071 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8803f8b4-a109-43cf-a66f-2b3fc5656e88 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:50.608570 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8803f8b4-a109-43cf-a66f-2b3fc5656e88 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:50.609702 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8803f8b4-a109-43cf-a66f-2b3fc5656e88 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1407 microversion: 2.20 time: 0.150838 Jul 20 11:44:50.610255 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 488/963] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:50 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:51.627964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cc033463-e200-4ffd-aacb-860d11bf39d1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:51.628571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cc033463-e200-4ffd-aacb-860d11bf39d1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:51.635128 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc033463-e200-4ffd-aacb-860d11bf39d1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:51.635569 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc033463-e200-4ffd-aacb-860d11bf39d1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:51.636396 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc033463-e200-4ffd-aacb-860d11bf39d1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:51.636848 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc033463-e200-4ffd-aacb-860d11bf39d1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:51.767052 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cc033463-e200-4ffd-aacb-860d11bf39d1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:51.774550 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cc033463-e200-4ffd-aacb-860d11bf39d1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:51.776862 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cc033463-e200-4ffd-aacb-860d11bf39d1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:51.777948 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cc033463-e200-4ffd-aacb-860d11bf39d1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1407 microversion: 2.20 time: 0.153864 Jul 20 11:44:51.778497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 476/964] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:51 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:52.795617 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4e3d182d-9355-4b80-bc74-101960859772 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:52.796338 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4e3d182d-9355-4b80-bc74-101960859772 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:52.802997 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3d182d-9355-4b80-bc74-101960859772 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:52.803453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3d182d-9355-4b80-bc74-101960859772 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:52.804260 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3d182d-9355-4b80-bc74-101960859772 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:52.804700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e3d182d-9355-4b80-bc74-101960859772 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:52.939918 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4e3d182d-9355-4b80-bc74-101960859772 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:52.948370 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4e3d182d-9355-4b80-bc74-101960859772 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:52.949896 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4e3d182d-9355-4b80-bc74-101960859772 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:52.951002 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4e3d182d-9355-4b80-bc74-101960859772 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1407 microversion: 2.20 time: 0.159457 Jul 20 11:44:52.951558 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 489/965] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:52 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:53.969320 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9b453d2d-f7c9-42fb-833c-93ea8076b29f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:53.969923 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9b453d2d-f7c9-42fb-833c-93ea8076b29f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:53.972194 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:53.972868 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:53.977627 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b453d2d-f7c9-42fb-833c-93ea8076b29f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:53.978072 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b453d2d-f7c9-42fb-833c-93ea8076b29f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:53.979421 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b453d2d-f7c9-42fb-833c-93ea8076b29f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:53.979848 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9b453d2d-f7c9-42fb-833c-93ea8076b29f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:54.120813 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9b453d2d-f7c9-42fb-833c-93ea8076b29f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:54.128834 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9b453d2d-f7c9-42fb-833c-93ea8076b29f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:54.130442 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9b453d2d-f7c9-42fb-833c-93ea8076b29f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:54.131587 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9b453d2d-f7c9-42fb-833c-93ea8076b29f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1407 microversion: 2.20 time: 0.166132 Jul 20 11:44:54.132139 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 477/966] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:53 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:54.146725 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-0f73a88e-ce6a-43fa-9062-4cc4f1f21f13 req-a2c957f5-f895-4dba-b5e3-99b4eb4bed4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38ac977-daa5-4751-a9e8-12c27706032e", "name": "network-vif-plugged", "status": "completed", "tag": "98fc8e3d-93c5-45a0-9829-77da42ba8ac3"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:54.151184 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=12 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:54.155591 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-0f73a88e-ce6a-43fa-9062-4cc4f1f21f13 req-a2c957f5-f895-4dba-b5e3-99b4eb4bed4b service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:54.156072 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-0f73a88e-ce6a-43fa-9062-4cc4f1f21f13 req-a2c957f5-f895-4dba-b5e3-99b4eb4bed4b service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:54.167166 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-0f73a88e-ce6a-43fa-9062-4cc4f1f21f13 req-a2c957f5-f895-4dba-b5e3-99b4eb4bed4b service nova] Creating event network-vif-plugged:98fc8e3d-93c5-45a0-9829-77da42ba8ac3 for instance e38ac977-daa5-4751-a9e8-12c27706032e on hv-cinder-82282 Jul 20 11:44:54.173444 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-0f73a88e-ce6a-43fa-9062-4cc4f1f21f13 req-a2c957f5-f895-4dba-b5e3-99b4eb4bed4b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030275 Jul 20 11:44:54.173444 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 490/967] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:44:55.149827 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-43be6a33-8b97-46c3-90fd-46bf3da2d295 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:55.151111 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-43be6a33-8b97-46c3-90fd-46bf3da2d295 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:55.157502 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43be6a33-8b97-46c3-90fd-46bf3da2d295 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:55.157936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43be6a33-8b97-46c3-90fd-46bf3da2d295 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:55.158688 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43be6a33-8b97-46c3-90fd-46bf3da2d295 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:55.159110 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43be6a33-8b97-46c3-90fd-46bf3da2d295 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:55.287495 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-43be6a33-8b97-46c3-90fd-46bf3da2d295 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:55.296310 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-43be6a33-8b97-46c3-90fd-46bf3da2d295 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:55.297885 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-43be6a33-8b97-46c3-90fd-46bf3da2d295 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:55.299020 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-43be6a33-8b97-46c3-90fd-46bf3da2d295 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1407 microversion: 2.20 time: 0.153135 Jul 20 11:44:55.299578 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 478/968] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:55 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:56.317496 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-da6e0f50-fcba-46fe-8e3a-22e6d7d60ea7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:56.318127 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-da6e0f50-fcba-46fe-8e3a-22e6d7d60ea7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:56.325636 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da6e0f50-fcba-46fe-8e3a-22e6d7d60ea7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:56.326084 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da6e0f50-fcba-46fe-8e3a-22e6d7d60ea7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:56.326853 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da6e0f50-fcba-46fe-8e3a-22e6d7d60ea7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:56.327293 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-da6e0f50-fcba-46fe-8e3a-22e6d7d60ea7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:56.456502 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-da6e0f50-fcba-46fe-8e3a-22e6d7d60ea7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:56.464414 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-da6e0f50-fcba-46fe-8e3a-22e6d7d60ea7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:56.465964 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-da6e0f50-fcba-46fe-8e3a-22e6d7d60ea7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:56.467114 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-da6e0f50-fcba-46fe-8e3a-22e6d7d60ea7 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1407 microversion: 2.20 time: 0.154022 Jul 20 11:44:56.467679 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 491/969] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:56 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:57.486792 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b7c378d2-a927-4366-a64f-e4c6bc63ff7d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:57.487436 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b7c378d2-a927-4366-a64f-e4c6bc63ff7d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:57.489834 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:44:57.495501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c378d2-a927-4366-a64f-e4c6bc63ff7d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:57.495952 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c378d2-a927-4366-a64f-e4c6bc63ff7d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:57.496727 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c378d2-a927-4366-a64f-e4c6bc63ff7d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:57.497299 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b7c378d2-a927-4366-a64f-e4c6bc63ff7d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:57.629658 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7c378d2-a927-4366-a64f-e4c6bc63ff7d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:57.638257 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7c378d2-a927-4366-a64f-e4c6bc63ff7d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:57.639802 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b7c378d2-a927-4366-a64f-e4c6bc63ff7d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:44:57.641032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b7c378d2-a927-4366-a64f-e4c6bc63ff7d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1599 microversion: 2.20 time: 0.159564 Jul 20 11:44:57.641593 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 479/970] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:44:57 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:44:57.659229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8482a938-5a84-46c0-84da-cdf4fca878f3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:44:57.659779 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8482a938-5a84-46c0-84da-cdf4fca878f3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:44:57.666396 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8482a938-5a84-46c0-84da-cdf4fca878f3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:57.666863 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8482a938-5a84-46c0-84da-cdf4fca878f3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:57.667619 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8482a938-5a84-46c0-84da-cdf4fca878f3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:57.668113 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8482a938-5a84-46c0-84da-cdf4fca878f3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:57.743130 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8482a938-5a84-46c0-84da-cdf4fca878f3 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087847 Jul 20 11:44:57.743723 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 492/971] 10.222.0.43 () {60 vars in 1315 bytes} [Wed Jul 20 11:44:57 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:44:59.026876 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-5cbe8b7f-6352-4459-9ee3-fa2c7226811b req-1c7b866c-6973-47ae-a593-3113d4098535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e38ac977-daa5-4751-a9e8-12c27706032e", "tag": "98fc8e3d-93c5-45a0-9829-77da42ba8ac3"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:44:59.038376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-5cbe8b7f-6352-4459-9ee3-fa2c7226811b req-1c7b866c-6973-47ae-a593-3113d4098535 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:44:59.038827 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-5cbe8b7f-6352-4459-9ee3-fa2c7226811b req-1c7b866c-6973-47ae-a593-3113d4098535 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:44:59.052306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-5cbe8b7f-6352-4459-9ee3-fa2c7226811b req-1c7b866c-6973-47ae-a593-3113d4098535 service nova] Creating event network-changed:98fc8e3d-93c5-45a0-9829-77da42ba8ac3 for instance e38ac977-daa5-4751-a9e8-12c27706032e on hv-cinder-82282 Jul 20 11:44:59.057309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-5cbe8b7f-6352-4459-9ee3-fa2c7226811b req-1c7b866c-6973-47ae-a593-3113d4098535 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035010 Jul 20 11:44:59.058058 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 480/972] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:45:25.492927 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:45:25.493781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:45:25.498318 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c210fbd1-9cc8-47be-86a2-873a7dbe93c4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:25.498807 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c210fbd1-9cc8-47be-86a2-873a7dbe93c4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:25.504698 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c210fbd1-9cc8-47be-86a2-873a7dbe93c4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:25.507103 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c210fbd1-9cc8-47be-86a2-873a7dbe93c4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:25.507103 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c210fbd1-9cc8-47be-86a2-873a7dbe93c4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:25.507103 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c210fbd1-9cc8-47be-86a2-873a7dbe93c4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:25.529672 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c210fbd1-9cc8-47be-86a2-873a7dbe93c4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/ips" status: 200 len: 149 microversion: 2.1 time: 0.038430 Jul 20 11:45:25.530245 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 493/973] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 11:45:25 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:45:28.280807 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:45:28.281626 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=52 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:45:28.286151 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d80e827e-3ecb-4900-bb41-9a039112e8cb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4123e197-a518-4973-9552-97df60535b81"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:45:28.287833 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d80e827e-3ecb-4900-bb41-9a039112e8cb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:28.305337 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d80e827e-3ecb-4900-bb41-9a039112e8cb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:28.306519 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d80e827e-3ecb-4900-bb41-9a039112e8cb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:28.309142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d80e827e-3ecb-4900-bb41-9a039112e8cb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:28.310016 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d80e827e-3ecb-4900-bb41-9a039112e8cb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:29.154832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d80e827e-3ecb-4900-bb41-9a039112e8cb tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "POST /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.875534 Jul 20 11:45:29.155450 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 481/974] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:45:28 2022] POST /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-volume_attachments => generated 194 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:45:37.712113 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3206c645-4274-4669-b9d9-4630099ff05d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4123e197-a518-4973-9552-97df60535b81"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:45:37.713376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3206c645-4274-4669-b9d9-4630099ff05d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:37.721287 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3206c645-4274-4669-b9d9-4630099ff05d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:37.721734 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3206c645-4274-4669-b9d9-4630099ff05d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:37.722499 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3206c645-4274-4669-b9d9-4630099ff05d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:37.722934 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3206c645-4274-4669-b9d9-4630099ff05d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:37.868224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-3206c645-4274-4669-b9d9-4630099ff05d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Invalid volume: volume 4123e197-a518-4973-9552-97df60535b81 is already attached to instances: fd665a70-b047-4bf2-b775-2f93e1be084c Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3206c645-4274-4669-b9d9-4630099ff05d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: POST /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-volume_attachments HTTP/1.1 Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 74 Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:45:37.870034 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:45:37.872149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:45:37.872149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:45:37.872149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:45:37.872149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:45:37.872149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:45:37.872149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:45:37.872149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:45:37.872149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:45:37.872149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:45:37.872149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Jul 20 11:45:37.872149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {"volumeAttachment": {"volumeId": "4123e197-a518-4973-9552-97df60535b81"}} Jul 20 11:45:37.872149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Invalid volume: volume 4123e197-a518-4973-9552-97df60535b81 is already attached to instances: fd665a70-b047-4bf2-b775-2f93e1be084c Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'server_id': 'fd665a70-b047-4bf2-b775-2f93e1be084c', 'body': {'volumeAttachment': {'volumeId': '4123e197-a518-4973-9552-97df60535b81'}}} Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4123e197-a518-4973-9552-97df60535b81 is already attached to instances: fd665a70-b047-4bf2-b775-2f93e1be084c Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:45:37.873128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4123e197-a518-4973-9552-97df60535b81 is already attached to instances: fd665a70-b047-4bf2-b775-2f93e1be084c Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:45:37.874764 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:45:37.876417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:45:37.876417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:45:37.876417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:45:37.876417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4123e197-a518-4973-9552-97df60535b81 is already attached to instances: fd665a70-b047-4bf2-b775-2f93e1be084c Jul 20 11:45:37.876417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:45:37.876417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3206c645-4274-4669-b9d9-4630099ff05d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 400 to user: Invalid volume: volume 4123e197-a518-4973-9552-97df60535b81 is already attached to instances: fd665a70-b047-4bf2-b775-2f93e1be084c {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:45:37.876417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3206c645-4274-4669-b9d9-4630099ff05d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "POST /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.164503 Jul 20 11:45:37.876417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 494/975] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:45:37 2022] POST /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-volume_attachments => generated 174 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:45:37.934769 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1eecca79-07bd-4a38-b05c-f6efbdd50eac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:37.935347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1eecca79-07bd-4a38-b05c-f6efbdd50eac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:37.941530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1eecca79-07bd-4a38-b05c-f6efbdd50eac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:37.941981 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1eecca79-07bd-4a38-b05c-f6efbdd50eac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:37.942747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1eecca79-07bd-4a38-b05c-f6efbdd50eac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:37.943181 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1eecca79-07bd-4a38-b05c-f6efbdd50eac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:38.026069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-1eecca79-07bd-4a38-b05c-f6efbdd50eac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lazy-loading 'services' on Instance uuid fd665a70-b047-4bf2-b775-2f93e1be084c {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:45:38.229964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1eecca79-07bd-4a38-b05c-f6efbdd50eac tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-volume_attachments/4123e197-a518-4973-9552-97df60535b81" status: 202 len: 0 microversion: 2.1 time: 0.300358 Jul 20 11:45:38.230548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 482/976] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 11:45:37 2022] DELETE /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-volume_attachments/4123e197-a518-4973-9552-97df60535b81 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:45:38.239468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0f0a5a8f-530e-46b5-a225-1f6b27fc6da4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:38.242120 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0f0a5a8f-530e-46b5-a225-1f6b27fc6da4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:38.246556 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f0a5a8f-530e-46b5-a225-1f6b27fc6da4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:38.247001 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f0a5a8f-530e-46b5-a225-1f6b27fc6da4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:38.247779 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f0a5a8f-530e-46b5-a225-1f6b27fc6da4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:38.248212 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0f0a5a8f-530e-46b5-a225-1f6b27fc6da4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:38.283266 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0f0a5a8f-530e-46b5-a225-1f6b27fc6da4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047652 Jul 20 11:45:38.283819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 495/977] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:45:38 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:45:39.298311 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8f0f73ed-540d-47de-9ca2-9112da775417 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:39.299376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8f0f73ed-540d-47de-9ca2-9112da775417 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:39.305901 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f0f73ed-540d-47de-9ca2-9112da775417 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:39.306382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f0f73ed-540d-47de-9ca2-9112da775417 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:39.307220 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f0f73ed-540d-47de-9ca2-9112da775417 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:39.307656 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f0f73ed-540d-47de-9ca2-9112da775417 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:39.341968 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8f0f73ed-540d-47de-9ca2-9112da775417 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049715 Jul 20 11:45:39.342544 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 483/978] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:45:39 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:45:40.354220 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2cdb5892-c70b-4b1e-8c75-2a19391780d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:40.355133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2cdb5892-c70b-4b1e-8c75-2a19391780d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:40.361095 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cdb5892-c70b-4b1e-8c75-2a19391780d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:40.361539 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cdb5892-c70b-4b1e-8c75-2a19391780d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:40.362324 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cdb5892-c70b-4b1e-8c75-2a19391780d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:40.362754 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2cdb5892-c70b-4b1e-8c75-2a19391780d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:40.389914 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2cdb5892-c70b-4b1e-8c75-2a19391780d9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040363 Jul 20 11:45:40.390388 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 496/979] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:45:40 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:45:40.446080 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bd045bc9-ec32-4963-90d5-ce41878fb078 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:40.446564 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bd045bc9-ec32-4963-90d5-ce41878fb078 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:40.452966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd045bc9-ec32-4963-90d5-ce41878fb078 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:40.453419 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd045bc9-ec32-4963-90d5-ce41878fb078 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:40.454186 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd045bc9-ec32-4963-90d5-ce41878fb078 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:40.454624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bd045bc9-ec32-4963-90d5-ce41878fb078 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:40.480008 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bd045bc9-ec32-4963-90d5-ce41878fb078 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:45:40.743144 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bd045bc9-ec32-4963-90d5-ce41878fb078 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 204 len: 0 microversion: 2.1 time: 0.300575 Jul 20 11:45:40.743735 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 484/980] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:45:40 2022] DELETE /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:45:40.759040 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d2f05f04-b0cd-47fc-914e-96de4771372b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:40.760208 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d2f05f04-b0cd-47fc-914e-96de4771372b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:40.766234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2f05f04-b0cd-47fc-914e-96de4771372b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:40.766686 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2f05f04-b0cd-47fc-914e-96de4771372b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:40.767453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2f05f04-b0cd-47fc-914e-96de4771372b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:40.767888 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d2f05f04-b0cd-47fc-914e-96de4771372b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:40.898718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d2f05f04-b0cd-47fc-914e-96de4771372b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:40.907011 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d2f05f04-b0cd-47fc-914e-96de4771372b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1680 microversion: 2.1 time: 0.151812 Jul 20 11:45:40.907571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 497/981] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:40 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:45:41.924775 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-68bc4362-716e-458b-8116-3c4b434e9f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:41.925488 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-68bc4362-716e-458b-8116-3c4b434e9f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:41.932496 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68bc4362-716e-458b-8116-3c4b434e9f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:41.932972 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68bc4362-716e-458b-8116-3c4b434e9f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:41.933728 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68bc4362-716e-458b-8116-3c4b434e9f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:41.934157 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-68bc4362-716e-458b-8116-3c4b434e9f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:42.063190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-68bc4362-716e-458b-8116-3c4b434e9f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:42.070726 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-68bc4362-716e-458b-8116-3c4b434e9f40 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1680 microversion: 2.1 time: 0.150139 Jul 20 11:45:42.071284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 485/982] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:41 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:45:43.088427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dfe0943c-28d0-45ac-a8f4-4d9191ee61c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:43.089066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dfe0943c-28d0-45ac-a8f4-4d9191ee61c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:43.095415 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfe0943c-28d0-45ac-a8f4-4d9191ee61c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:43.095862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfe0943c-28d0-45ac-a8f4-4d9191ee61c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:43.096629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfe0943c-28d0-45ac-a8f4-4d9191ee61c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:43.097139 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dfe0943c-28d0-45ac-a8f4-4d9191ee61c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:43.229975 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-dfe0943c-28d0-45ac-a8f4-4d9191ee61c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:43.237450 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dfe0943c-28d0-45ac-a8f4-4d9191ee61c8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1680 microversion: 2.1 time: 0.152888 Jul 20 11:45:43.238022 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 498/983] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:43 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:45:43.865233 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-da73ff03-23f2-4923-b133-af8cf017a686 req-7f3c310c-c3dd-4a3f-93b9-554073b941d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd665a70-b047-4bf2-b775-2f93e1be084c", "name": "network-vif-deleted", "tag": "d410a05b-4bb6-4dde-aed0-6560bd683bc1"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:45:43.874436 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-da73ff03-23f2-4923-b133-af8cf017a686 req-7f3c310c-c3dd-4a3f-93b9-554073b941d6 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:43.874436 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-da73ff03-23f2-4923-b133-af8cf017a686 req-7f3c310c-c3dd-4a3f-93b9-554073b941d6 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:43.886253 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-da73ff03-23f2-4923-b133-af8cf017a686 req-7f3c310c-c3dd-4a3f-93b9-554073b941d6 service nova] Creating event network-vif-deleted:d410a05b-4bb6-4dde-aed0-6560bd683bc1 for instance fd665a70-b047-4bf2-b775-2f93e1be084c on hv-cinder-82282 Jul 20 11:45:43.891261 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-da73ff03-23f2-4923-b133-af8cf017a686 req-7f3c310c-c3dd-4a3f-93b9-554073b941d6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029787 Jul 20 11:45:43.892073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 486/984] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:45:44.256012 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-32467704-ab37-4fa5-a99e-bf16e6658c9d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:44.256654 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-32467704-ab37-4fa5-a99e-bf16e6658c9d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:44.263958 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32467704-ab37-4fa5-a99e-bf16e6658c9d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:44.265763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32467704-ab37-4fa5-a99e-bf16e6658c9d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:44.265763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32467704-ab37-4fa5-a99e-bf16e6658c9d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:44.265763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32467704-ab37-4fa5-a99e-bf16e6658c9d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:44.297501 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32467704-ab37-4fa5-a99e-bf16e6658c9d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:44.297954 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-32467704-ab37-4fa5-a99e-bf16e6658c9d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:44.298458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-32467704-ab37-4fa5-a99e-bf16e6658c9d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lazy-loading 'fault' on Instance uuid fd665a70-b047-4bf2-b775-2f93e1be084c {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:45:44.341367 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-32467704-ab37-4fa5-a99e-bf16e6658c9d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:44.348856 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-32467704-ab37-4fa5-a99e-bf16e6658c9d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 200 len: 1331 microversion: 2.1 time: 0.097174 Jul 20 11:45:44.349424 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 499/985] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:44 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:45:45.366640 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2bddf9a8-c2fb-4ab1-8767-a320111e7702 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:45.367358 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2bddf9a8-c2fb-4ab1-8767-a320111e7702 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:45.373890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bddf9a8-c2fb-4ab1-8767-a320111e7702 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:45.374337 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bddf9a8-c2fb-4ab1-8767-a320111e7702 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:45.375106 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bddf9a8-c2fb-4ab1-8767-a320111e7702 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:45.375540 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2bddf9a8-c2fb-4ab1-8767-a320111e7702 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:45.389285 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-2bddf9a8-c2fb-4ab1-8767-a320111e7702 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2bddf9a8-c2fb-4ab1-8767-a320111e7702 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c HTTP/1.1 Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:45:45.390936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:45:45.392528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:45:45.392528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:45:45.392528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:45:45.392528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:45:45.392528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:45:45.392528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:45:45.392528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:45:45.392528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:45:45.392528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:45:45.392528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:45:45.392528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:45:45.392528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'fd665a70-b047-4bf2-b775-2f93e1be084c'} Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:45:45.393732 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:45:45.395360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:45:45.396985 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2bddf9a8-c2fb-4ab1-8767-a320111e7702 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 404 to user: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:45:45.396985 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2bddf9a8-c2fb-4ab1-8767-a320111e7702 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 404 len: 111 microversion: 2.1 time: 0.029935 Jul 20 11:45:45.396985 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 487/986] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:45 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:45:45.402176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3a8149fb-b2bc-4638-906a-64fb88b702e4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '.version_select at 0x7f44e03cd310>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:45.474965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3a8149fb-b2bc-4638-906a-64fb88b702e4 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-187577268" status: 202 len: 0 microversion: 2.1 time: 0.077575 Jul 20 11:45:45.475691 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 500/987] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jul 20 11:45:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-187577268 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:45:46.470693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-73b77780-c73e-49cd-8a7f-45169ea79a0e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Action: 'create', calling method: .version_select at 0x7f44e04df280>, body: {"keypair": {"name": "tempest-keypair-1268452392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyWE8duc9NaSLL71gsXkc68UaSIy9I+L5jfZkbsiyJwcHBnR1C98zS7nhHpY6iY80ESKau/nA9uDuqTz1ZA7PZ8hGMgeWiyCYpTkd8uaasFxSFt/wTcVtgbkOE/ZOn5xQ=="}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:45:46.484775 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-73b77780-c73e-49cd-8a7f-45169ea79a0e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for project d4fa73c956fe44a59272f727320743e0. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:45:46.488527 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-73b77780-c73e-49cd-8a7f-45169ea79a0e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for user 54c7d577e64f48cab8c331ff192be0a6 and project d4fa73c956fe44a59272f727320743e0. Resources: {'key_pairs'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:45:46.567011 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-73b77780-c73e-49cd-8a7f-45169ea79a0e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100231 Jul 20 11:45:46.567630 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 488/988] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 11:45:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:45:48.832359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1332794796", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85e4b01a-11ce-4686-bb2f-1c5b19de2e34"}], "security_groups": [{"name": "tempest-securitygroup--1418413945"}], "key_name": "tempest-keypair-1268452392", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:45:48.932770 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] validate_networks() for [('85e4b01a-11ce-4686-bb2f-1c5b19de2e34', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:45:49.298441 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:45:49.298870 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:45:49.299339 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:45:49.299748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:45:49.300158 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:45:49.309468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:49.309917 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:49.310749 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:49.311187 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:49.327434 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for project d4fa73c956fe44a59272f727320743e0. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:45:49.331666 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Getting quotas for user 54c7d577e64f48cab8c331ff192be0a6 and project d4fa73c956fe44a59272f727320743e0. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:45:49.343314 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:45:49.345801 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:45:49.482365 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b367ef54-e07d-443e-88cf-35b33f86a0dc tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.655055 Jul 20 11:45:49.483077 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 501/989] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:45:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:45:49.493606 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-75923cb0-cd1e-4479-b5ce-47b0cebcfc8d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:49.494252 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-75923cb0-cd1e-4479-b5ce-47b0cebcfc8d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:49.554505 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-75923cb0-cd1e-4479-b5ce-47b0cebcfc8d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:49.561468 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-75923cb0-cd1e-4479-b5ce-47b0cebcfc8d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1242 microversion: 2.1 time: 0.072118 Jul 20 11:45:49.562035 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 489/990] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:49 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:45:50.579516 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e4df74bd-35f1-46cd-8a99-7522a412cb01 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:50.580107 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e4df74bd-35f1-46cd-8a99-7522a412cb01 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:50.587516 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4df74bd-35f1-46cd-8a99-7522a412cb01 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:50.589597 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4df74bd-35f1-46cd-8a99-7522a412cb01 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:50.590536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4df74bd-35f1-46cd-8a99-7522a412cb01 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:50.590991 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e4df74bd-35f1-46cd-8a99-7522a412cb01 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:50.651412 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e4df74bd-35f1-46cd-8a99-7522a412cb01 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:50.659912 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e4df74bd-35f1-46cd-8a99-7522a412cb01 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1238 microversion: 2.1 time: 0.085286 Jul 20 11:45:50.663549 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 502/991] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:50 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:45:51.679551 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f8359fa-d8f0-4660-9dfb-700dd1dc5024 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:51.680252 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f8359fa-d8f0-4660-9dfb-700dd1dc5024 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:51.687200 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f8359fa-d8f0-4660-9dfb-700dd1dc5024 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:51.687642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f8359fa-d8f0-4660-9dfb-700dd1dc5024 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:51.688410 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f8359fa-d8f0-4660-9dfb-700dd1dc5024 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:51.688872 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f8359fa-d8f0-4660-9dfb-700dd1dc5024 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:51.750604 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f8359fa-d8f0-4660-9dfb-700dd1dc5024 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:51.757992 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f8359fa-d8f0-4660-9dfb-700dd1dc5024 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1312 microversion: 2.1 time: 0.082437 Jul 20 11:45:51.758544 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 490/992] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:51 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1312 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:45:52.775737 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9f2625fe-544c-49f6-9603-f046ad6d8027 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:52.776486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9f2625fe-544c-49f6-9603-f046ad6d8027 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:52.783263 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f2625fe-544c-49f6-9603-f046ad6d8027 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:52.783785 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f2625fe-544c-49f6-9603-f046ad6d8027 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:52.784774 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f2625fe-544c-49f6-9603-f046ad6d8027 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:52.785229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9f2625fe-544c-49f6-9603-f046ad6d8027 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:52.927628 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9f2625fe-544c-49f6-9603-f046ad6d8027 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:52.927628 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9f2625fe-544c-49f6-9603-f046ad6d8027 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1368 microversion: 2.1 time: 0.154008 Jul 20 11:45:52.927628 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 503/993] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:52 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:45:53.297794 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-87a73fbe-7615-48ac-b784-e1514a9ea728 req-bb141cd9-d7cb-4b07-afd8-a65694a9c99b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418", "tag": "e8a2e484-b12d-4057-9d2f-36ca9d81ce4d"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:45:53.306171 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-87a73fbe-7615-48ac-b784-e1514a9ea728 req-bb141cd9-d7cb-4b07-afd8-a65694a9c99b service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:53.307268 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-87a73fbe-7615-48ac-b784-e1514a9ea728 req-bb141cd9-d7cb-4b07-afd8-a65694a9c99b service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:53.318759 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-87a73fbe-7615-48ac-b784-e1514a9ea728 req-bb141cd9-d7cb-4b07-afd8-a65694a9c99b service nova] Creating event network-changed:e8a2e484-b12d-4057-9d2f-36ca9d81ce4d for instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 on hv-cinder-82282 Jul 20 11:45:53.323774 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-87a73fbe-7615-48ac-b784-e1514a9ea728 req-bb141cd9-d7cb-4b07-afd8-a65694a9c99b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100268 Jul 20 11:45:53.331412 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 491/994] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:45:53.943449 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e64e5014-68c8-48dd-97c9-4f0857c187fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:53.944154 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e64e5014-68c8-48dd-97c9-4f0857c187fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:53.951326 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e64e5014-68c8-48dd-97c9-4f0857c187fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:53.954994 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e64e5014-68c8-48dd-97c9-4f0857c187fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:53.954994 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e64e5014-68c8-48dd-97c9-4f0857c187fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:53.954994 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e64e5014-68c8-48dd-97c9-4f0857c187fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:54.091276 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e64e5014-68c8-48dd-97c9-4f0857c187fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:54.098540 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e64e5014-68c8-48dd-97c9-4f0857c187fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1368 microversion: 2.1 time: 0.159074 Jul 20 11:45:54.099099 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 504/995] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:53 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:45:55.116688 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-099aea60-c665-4083-8933-793d68f532c2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:55.117432 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-099aea60-c665-4083-8933-793d68f532c2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:55.123622 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-099aea60-c665-4083-8933-793d68f532c2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:55.124067 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-099aea60-c665-4083-8933-793d68f532c2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:55.124963 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-099aea60-c665-4083-8933-793d68f532c2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:55.125394 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-099aea60-c665-4083-8933-793d68f532c2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:55.256613 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-099aea60-c665-4083-8933-793d68f532c2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:55.264521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-099aea60-c665-4083-8933-793d68f532c2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1368 microversion: 2.1 time: 0.152647 Jul 20 11:45:55.265119 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 492/996] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:55 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:45:56.282242 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2c521078-53b8-46d4-9195-5920a86827d6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:56.282861 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2c521078-53b8-46d4-9195-5920a86827d6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:56.289390 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c521078-53b8-46d4-9195-5920a86827d6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:56.289839 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c521078-53b8-46d4-9195-5920a86827d6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:56.290605 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c521078-53b8-46d4-9195-5920a86827d6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:56.291662 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2c521078-53b8-46d4-9195-5920a86827d6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:56.425295 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2c521078-53b8-46d4-9195-5920a86827d6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:56.432705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2c521078-53b8-46d4-9195-5920a86827d6 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1368 microversion: 2.1 time: 0.154392 Jul 20 11:45:56.433304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 505/997] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:56 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:45:57.449219 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c6c7c25f-1104-4608-98c7-524418eafd82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:57.449775 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c6c7c25f-1104-4608-98c7-524418eafd82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:57.456227 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6c7c25f-1104-4608-98c7-524418eafd82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:57.456673 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6c7c25f-1104-4608-98c7-524418eafd82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:57.457468 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6c7c25f-1104-4608-98c7-524418eafd82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:57.457903 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c6c7c25f-1104-4608-98c7-524418eafd82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:57.584152 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c6c7c25f-1104-4608-98c7-524418eafd82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:57.592098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c6c7c25f-1104-4608-98c7-524418eafd82 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1368 microversion: 2.1 time: 0.146791 Jul 20 11:45:57.592667 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 493/998] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:57 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:45:58.609392 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2b66e4d4-e24b-43e9-b634-ec86517d4e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:58.609979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2b66e4d4-e24b-43e9-b634-ec86517d4e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:58.616418 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b66e4d4-e24b-43e9-b634-ec86517d4e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:58.616973 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b66e4d4-e24b-43e9-b634-ec86517d4e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:58.617729 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b66e4d4-e24b-43e9-b634-ec86517d4e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:58.618160 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2b66e4d4-e24b-43e9-b634-ec86517d4e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:58.752927 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2b66e4d4-e24b-43e9-b634-ec86517d4e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:58.761451 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2b66e4d4-e24b-43e9-b634-ec86517d4e7c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1368 microversion: 2.1 time: 0.155619 Jul 20 11:45:58.762045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 506/999] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:58 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:45:59.778772 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e72dd7d0-9c33-4d9c-98e8-35f795c92b59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:45:59.779382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e72dd7d0-9c33-4d9c-98e8-35f795c92b59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:45:59.781868 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:45:59.785344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:45:59.787340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e72dd7d0-9c33-4d9c-98e8-35f795c92b59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:59.787800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e72dd7d0-9c33-4d9c-98e8-35f795c92b59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:59.788566 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e72dd7d0-9c33-4d9c-98e8-35f795c92b59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:45:59.789028 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e72dd7d0-9c33-4d9c-98e8-35f795c92b59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:45:59.793435 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:45:59.918438 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e72dd7d0-9c33-4d9c-98e8-35f795c92b59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:45:59.925627 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e72dd7d0-9c33-4d9c-98e8-35f795c92b59 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1368 microversion: 2.1 time: 0.151054 Jul 20 11:45:59.926200 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 494/1000] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:45:59 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:00.413751 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-9481e80e-603c-40cb-b464-89cfe3d33e96 req-da9059c9-3d38-46e5-9000-b144041377be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418", "name": "network-vif-plugged", "status": "completed", "tag": "e8a2e484-b12d-4057-9d2f-36ca9d81ce4d"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:00.417436 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:00.418100 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=6 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:00.423686 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-9481e80e-603c-40cb-b464-89cfe3d33e96 req-da9059c9-3d38-46e5-9000-b144041377be service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:00.424123 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-9481e80e-603c-40cb-b464-89cfe3d33e96 req-da9059c9-3d38-46e5-9000-b144041377be service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:00.434883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-9481e80e-603c-40cb-b464-89cfe3d33e96 req-da9059c9-3d38-46e5-9000-b144041377be service nova] Creating event network-vif-plugged:e8a2e484-b12d-4057-9d2f-36ca9d81ce4d for instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 on hv-cinder-82282 Jul 20 11:46:00.440092 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-9481e80e-603c-40cb-b464-89cfe3d33e96 req-da9059c9-3d38-46e5-9000-b144041377be service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029915 Jul 20 11:46:00.442907 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 507/1001] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:46:00.942679 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c11d7872-fe52-461e-9f0b-791e1b6b94cf tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:00.943293 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c11d7872-fe52-461e-9f0b-791e1b6b94cf tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:00.951251 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c11d7872-fe52-461e-9f0b-791e1b6b94cf tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:00.951702 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c11d7872-fe52-461e-9f0b-791e1b6b94cf tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:00.952462 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c11d7872-fe52-461e-9f0b-791e1b6b94cf tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:00.952931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c11d7872-fe52-461e-9f0b-791e1b6b94cf tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:01.086175 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c11d7872-fe52-461e-9f0b-791e1b6b94cf tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:01.094102 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c11d7872-fe52-461e-9f0b-791e1b6b94cf tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1368 microversion: 2.1 time: 0.155711 Jul 20 11:46:01.094665 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 495/1002] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:00 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:02.112042 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a0d1de92-c09f-418e-83d9-348637c0e9df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:02.112648 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a0d1de92-c09f-418e-83d9-348637c0e9df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:02.119705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0d1de92-c09f-418e-83d9-348637c0e9df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:02.120143 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0d1de92-c09f-418e-83d9-348637c0e9df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:02.121014 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0d1de92-c09f-418e-83d9-348637c0e9df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:02.121447 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a0d1de92-c09f-418e-83d9-348637c0e9df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:02.251958 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a0d1de92-c09f-418e-83d9-348637c0e9df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:02.260305 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a0d1de92-c09f-418e-83d9-348637c0e9df tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1368 microversion: 2.1 time: 0.153147 Jul 20 11:46:02.260901 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 508/1003] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:02 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:03.277949 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-830d0528-b9d7-48f5-89c5-c1ff34e9ddc8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:03.278617 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-830d0528-b9d7-48f5-89c5-c1ff34e9ddc8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:03.285021 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-830d0528-b9d7-48f5-89c5-c1ff34e9ddc8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:03.285464 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-830d0528-b9d7-48f5-89c5-c1ff34e9ddc8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:03.286217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-830d0528-b9d7-48f5-89c5-c1ff34e9ddc8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:03.286645 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-830d0528-b9d7-48f5-89c5-c1ff34e9ddc8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:03.410912 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-830d0528-b9d7-48f5-89c5-c1ff34e9ddc8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:03.419052 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-830d0528-b9d7-48f5-89c5-c1ff34e9ddc8 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1557 microversion: 2.1 time: 0.145824 Jul 20 11:46:03.419623 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 496/1004] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:03 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:03.435795 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-efa7d8db-379e-40f9-b911-640daf1827a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:03.436300 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-efa7d8db-379e-40f9-b911-640daf1827a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:03.442714 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa7d8db-379e-40f9-b911-640daf1827a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:03.443165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa7d8db-379e-40f9-b911-640daf1827a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:03.443933 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa7d8db-379e-40f9-b911-640daf1827a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:03.444373 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efa7d8db-379e-40f9-b911-640daf1827a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:03.522261 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-efa7d8db-379e-40f9-b911-640daf1827a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090873 Jul 20 11:46:03.522851 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 509/1005] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 11:46:03 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:46:04.471104 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-93fb4df8-9512-4bf9-8214-d234e0b0b47d req-751447c1-a101-4987-a125-d39e0a364fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418", "tag": "e8a2e484-b12d-4057-9d2f-36ca9d81ce4d"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:04.480864 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-93fb4df8-9512-4bf9-8214-d234e0b0b47d req-751447c1-a101-4987-a125-d39e0a364fa2 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:04.481308 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-93fb4df8-9512-4bf9-8214-d234e0b0b47d req-751447c1-a101-4987-a125-d39e0a364fa2 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:04.491884 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-93fb4df8-9512-4bf9-8214-d234e0b0b47d req-751447c1-a101-4987-a125-d39e0a364fa2 service nova] Creating event network-changed:e8a2e484-b12d-4057-9d2f-36ca9d81ce4d for instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 on hv-cinder-82282 Jul 20 11:46:04.497500 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-93fb4df8-9512-4bf9-8214-d234e0b0b47d req-751447c1-a101-4987-a125-d39e0a364fa2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030135 Jul 20 11:46:04.498177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 497/1006] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:46:14.726971 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0776abde-aa5d-4e2d-9aa9-bd52982ba70d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:14.727478 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0776abde-aa5d-4e2d-9aa9-bd52982ba70d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:14.727730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=7 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:14.729231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=19 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:14.731335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:14.732066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=86 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:14.733478 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-da933061-d811-4b8c-8248-e448f3c001a7 req-e86967aa-73b2-41ef-a137-5a2f58582714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eed301b-e35c-451d-931b-d25233e890f7", "tag": "4beedb58-67b0-40d2-ab20-ba7385d750c0"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:14.737038 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0776abde-aa5d-4e2d-9aa9-bd52982ba70d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:14.737553 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0776abde-aa5d-4e2d-9aa9-bd52982ba70d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:14.738565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0776abde-aa5d-4e2d-9aa9-bd52982ba70d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:14.739080 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0776abde-aa5d-4e2d-9aa9-bd52982ba70d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:14.741875 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-da933061-d811-4b8c-8248-e448f3c001a7 req-e86967aa-73b2-41ef-a137-5a2f58582714 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:14.747414 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-da933061-d811-4b8c-8248-e448f3c001a7 req-e86967aa-73b2-41ef-a137-5a2f58582714 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:14.754176 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-da933061-d811-4b8c-8248-e448f3c001a7 req-e86967aa-73b2-41ef-a137-5a2f58582714 service nova] Creating event network-changed:4beedb58-67b0-40d2-ab20-ba7385d750c0 for instance 1eed301b-e35c-451d-931b-d25233e890f7 on hv-cinder-82282 Jul 20 11:46:14.759819 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-da933061-d811-4b8c-8248-e448f3c001a7 req-e86967aa-73b2-41ef-a137-5a2f58582714 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033450 Jul 20 11:46:14.760494 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 498/1007] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:46:14.765902 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0776abde-aa5d-4e2d-9aa9-bd52982ba70d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:46:15.087415 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0776abde-aa5d-4e2d-9aa9-bd52982ba70d tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 204 len: 0 microversion: 2.1 time: 0.364379 Jul 20 11:46:15.091798 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 510/1008] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:46:14 2022] DELETE /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:46:15.098393 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f8ddaa2-0d57-4540-aa66-9aa9ad5d2b06 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:15.099572 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f8ddaa2-0d57-4540-aa66-9aa9ad5d2b06 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:15.108143 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f8ddaa2-0d57-4540-aa66-9aa9ad5d2b06 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:15.108878 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f8ddaa2-0d57-4540-aa66-9aa9ad5d2b06 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:15.109938 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f8ddaa2-0d57-4540-aa66-9aa9ad5d2b06 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:15.110532 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f8ddaa2-0d57-4540-aa66-9aa9ad5d2b06 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:15.261271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7f8ddaa2-0d57-4540-aa66-9aa9ad5d2b06 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:15.268778 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f8ddaa2-0d57-4540-aa66-9aa9ad5d2b06 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.175493 Jul 20 11:46:15.269391 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 499/1009] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:15 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:16.286110 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3dc77877-0f3e-4fc8-a110-ee04aff3f627 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:16.286802 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3dc77877-0f3e-4fc8-a110-ee04aff3f627 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:16.293511 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3dc77877-0f3e-4fc8-a110-ee04aff3f627 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:16.293955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3dc77877-0f3e-4fc8-a110-ee04aff3f627 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:16.294718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3dc77877-0f3e-4fc8-a110-ee04aff3f627 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:16.295149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3dc77877-0f3e-4fc8-a110-ee04aff3f627 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:16.422537 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3dc77877-0f3e-4fc8-a110-ee04aff3f627 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:16.429885 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3dc77877-0f3e-4fc8-a110-ee04aff3f627 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1569 microversion: 2.1 time: 0.147961 Jul 20 11:46:16.430451 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 511/1010] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:16 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:17.451615 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dbc60d4b-c1b9-48b2-a1ba-c5931fdfa16a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:17.452225 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dbc60d4b-c1b9-48b2-a1ba-c5931fdfa16a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:17.458773 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbc60d4b-c1b9-48b2-a1ba-c5931fdfa16a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:17.459222 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbc60d4b-c1b9-48b2-a1ba-c5931fdfa16a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:17.459991 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbc60d4b-c1b9-48b2-a1ba-c5931fdfa16a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:17.460427 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dbc60d4b-c1b9-48b2-a1ba-c5931fdfa16a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:17.593838 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dbc60d4b-c1b9-48b2-a1ba-c5931fdfa16a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:17.601415 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dbc60d4b-c1b9-48b2-a1ba-c5931fdfa16a tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1451 microversion: 2.1 time: 0.153736 Jul 20 11:46:17.601990 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 500/1011] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:17 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:46:17.807229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-31f9f5c4-80fb-403c-b162-20690df8f6b1 req-99862328-0c83-4536-90e6-990bd137a234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eed301b-e35c-451d-931b-d25233e890f7", "name": "network-vif-deleted", "tag": "4beedb58-67b0-40d2-ab20-ba7385d750c0"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:17.815883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-31f9f5c4-80fb-403c-b162-20690df8f6b1 req-99862328-0c83-4536-90e6-990bd137a234 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:17.820959 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-31f9f5c4-80fb-403c-b162-20690df8f6b1 req-99862328-0c83-4536-90e6-990bd137a234 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:17.830008 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-31f9f5c4-80fb-403c-b162-20690df8f6b1 req-99862328-0c83-4536-90e6-990bd137a234 service nova] Creating event network-vif-deleted:4beedb58-67b0-40d2-ab20-ba7385d750c0 for instance 1eed301b-e35c-451d-931b-d25233e890f7 on hv-cinder-82282 Jul 20 11:46:17.835203 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-31f9f5c4-80fb-403c-b162-20690df8f6b1 req-99862328-0c83-4536-90e6-990bd137a234 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032181 Jul 20 11:46:17.835789 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 512/1012] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:46:17.849712 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fd87a2db-f9ce-4314-ad3b-a3157f04c63d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:17.849712 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fd87a2db-f9ce-4314-ad3b-a3157f04c63d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:17.853476 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd87a2db-f9ce-4314-ad3b-a3157f04c63d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:17.853929 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd87a2db-f9ce-4314-ad3b-a3157f04c63d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:17.854690 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd87a2db-f9ce-4314-ad3b-a3157f04c63d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:17.855126 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fd87a2db-f9ce-4314-ad3b-a3157f04c63d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:17.879062 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fd87a2db-f9ce-4314-ad3b-a3157f04c63d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/ips" status: 200 len: 144 microversion: 2.1 time: 0.035948 Jul 20 11:46:17.879641 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 501/1013] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 11:46:17 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:46:18.619467 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-609920ae-35f7-46be-a034-0c517b21750c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:18.620192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-609920ae-35f7-46be-a034-0c517b21750c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:18.626478 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-609920ae-35f7-46be-a034-0c517b21750c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:18.626921 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-609920ae-35f7-46be-a034-0c517b21750c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:18.627692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-609920ae-35f7-46be-a034-0c517b21750c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:18.628131 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-609920ae-35f7-46be-a034-0c517b21750c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:18.690193 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-609920ae-35f7-46be-a034-0c517b21750c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5040464b9adb4ca3a8bb131ff11e0032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8945c9c88e4f0e80f8f2345168827a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:18.698588 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-609920ae-35f7-46be-a034-0c517b21750c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 200 len: 1220 microversion: 2.1 time: 0.083539 Jul 20 11:46:18.700743 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 513/1014] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:18 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:19.715433 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9bceeba-0884-48fd-96c8-9e702fc3c65c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:19.717994 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a9bceeba-0884-48fd-96c8-9e702fc3c65c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] [instance: 1eed301b-e35c-451d-931b-d25233e890f7] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:19.722434 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9bceeba-0884-48fd-96c8-9e702fc3c65c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:19.722881 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9bceeba-0884-48fd-96c8-9e702fc3c65c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:19.723645 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9bceeba-0884-48fd-96c8-9e702fc3c65c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:19.724081 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a9bceeba-0884-48fd-96c8-9e702fc3c65c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:19.737570 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-a9bceeba-0884-48fd-96c8-9e702fc3c65c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] HTTP exception thrown: Instance 1eed301b-e35c-451d-931b-d25233e890f7 could not be found. Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9bceeba-0884-48fd-96c8-9e702fc3c65c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Request method failure captured: Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 HTTP/1.1 Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-lbWACcEpiGmvDdIw7kIhIVd0jO5nssnxr_pYKnXw5-tmPGbIwBWTJ96pS60Uf4PyOY05z9mYcuy4bMTOrLRajZ6FsMpxGMa3BTT6x8PrXzRIHIfrq0nyq9IdWC_x5ArXiHnQc0nSIVQcTLKA9xwjh0Tj8KhS55vMkN_vTFW4nq-b4 Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: cd8945c9c88e4f0e80f8f2345168827a Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestShelveInstance-1439320527 Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:46:19.739211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:46:19.741071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cd8945c9c88e4f0e80f8f2345168827a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cd8945c9c88e4f0e80f8f2345168827a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cd8945c9c88e4f0e80f8f2345168827a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cd8945c9c88e4f0e80f8f2345168827a"}]}] Jul 20 11:46:19.741071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestShelveInstance-1439320527 Jul 20 11:46:19.741071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: cd8945c9c88e4f0e80f8f2345168827a Jul 20 11:46:19.741071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestShelveInstance-1439320527 Jul 20 11:46:19.741071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-TestShelveInstance-1439320527-project Jul 20 11:46:19.741071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:46:19.741071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:46:19.741071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 5040464b9adb4ca3a8bb131ff11e0032 Jul 20 11:46:19.741071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestShelveInstance-1439320527-project Jul 20 11:46:19.741071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:46:19.741071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance 1eed301b-e35c-451d-931b-d25233e890f7 could not be found. Jul 20 11:46:19.741071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': '1eed301b-e35c-451d-931b-d25233e890f7'} Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eed301b-e35c-451d-931b-d25233e890f7 could not be found. Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:46:19.742195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eed301b-e35c-451d-931b-d25233e890f7 could not be found. Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eed301b-e35c-451d-931b-d25233e890f7 could not be found. Jul 20 11:46:19.744431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:46:19.748040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a9bceeba-0884-48fd-96c8-9e702fc3c65c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Returning 404 to user: Instance 1eed301b-e35c-451d-931b-d25233e890f7 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:46:19.748040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a9bceeba-0884-48fd-96c8-9e702fc3c65c tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7" status: 404 len: 111 microversion: 2.1 time: 0.029123 Jul 20 11:46:19.748040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 502/1015] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:19 2022] GET /compute/v2.1/servers/1eed301b-e35c-451d-931b-d25233e890f7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:46:19.971218 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5d0bddb5-281a-4145-a69e-eb43d4a87b85 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] Calling method '.version_select at 0x7f44daeec790>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:20.042619 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5d0bddb5-281a-4145-a69e-eb43d4a87b85 tempest-TestShelveInstance-1439320527 tempest-TestShelveInstance-1439320527-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1189455695" status: 202 len: 0 microversion: 2.1 time: 0.075144 Jul 20 11:46:20.043198 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 514/1016] 10.222.0.43 () {58 vars in 1253 bytes} [Wed Jul 20 11:46:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1189455695 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:46:20.881615 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4a2abf91-b191-4cb6-8e3f-486e8d63a27f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:20.882255 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4a2abf91-b191-4cb6-8e3f-486e8d63a27f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:20.889685 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a2abf91-b191-4cb6-8e3f-486e8d63a27f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:20.890135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a2abf91-b191-4cb6-8e3f-486e8d63a27f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:20.890936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a2abf91-b191-4cb6-8e3f-486e8d63a27f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:20.891349 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4a2abf91-b191-4cb6-8e3f-486e8d63a27f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:20.917124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4a2abf91-b191-4cb6-8e3f-486e8d63a27f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:46:21.217865 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4a2abf91-b191-4cb6-8e3f-486e8d63a27f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 204 len: 0 microversion: 2.1 time: 0.339775 Jul 20 11:46:21.218356 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 503/1017] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:46:20 2022] DELETE /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:46:21.226990 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ce37822d-664e-4d7d-ae6d-e2a1c7ddc5b8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:21.227599 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ce37822d-664e-4d7d-ae6d-e2a1c7ddc5b8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:21.234471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce37822d-664e-4d7d-ae6d-e2a1c7ddc5b8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:21.234917 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce37822d-664e-4d7d-ae6d-e2a1c7ddc5b8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:21.235682 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce37822d-664e-4d7d-ae6d-e2a1c7ddc5b8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:21.236117 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ce37822d-664e-4d7d-ae6d-e2a1c7ddc5b8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:21.381192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ce37822d-664e-4d7d-ae6d-e2a1c7ddc5b8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:21.390135 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ce37822d-664e-4d7d-ae6d-e2a1c7ddc5b8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1578 microversion: 2.1 time: 0.167461 Jul 20 11:46:21.391028 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 515/1018] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:21 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:21.412645 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b1c7e09a-8c2f-4575-acd6-334db732cd79 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:21.413343 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b1c7e09a-8c2f-4575-acd6-334db732cd79 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:21.421340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1c7e09a-8c2f-4575-acd6-334db732cd79 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:21.422304 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1c7e09a-8c2f-4575-acd6-334db732cd79 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:21.423391 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1c7e09a-8c2f-4575-acd6-334db732cd79 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:21.424232 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b1c7e09a-8c2f-4575-acd6-334db732cd79 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:21.451281 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b1c7e09a-8c2f-4575-acd6-334db732cd79 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/ips" status: 200 len: 152 microversion: 2.20 time: 0.042669 Jul 20 11:46:21.452153 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 504/1019] 10.222.0.43 () {60 vars in 1288 bytes} [Wed Jul 20 11:46:21 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:46:22.380595 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1c9210f1-8820-493c-874f-9a07aa7d4f54 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b52355bf-0fe0-48ef-9181-e20abc419a0a"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:22.381804 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1c9210f1-8820-493c-874f-9a07aa7d4f54 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:22.388643 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c9210f1-8820-493c-874f-9a07aa7d4f54 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:22.389124 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c9210f1-8820-493c-874f-9a07aa7d4f54 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:22.389906 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c9210f1-8820-493c-874f-9a07aa7d4f54 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:22.390339 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1c9210f1-8820-493c-874f-9a07aa7d4f54 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:22.409000 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-203e18a5-0e59-474b-8851-aee0df7c01be tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:22.410855 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-203e18a5-0e59-474b-8851-aee0df7c01be tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:22.418043 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-203e18a5-0e59-474b-8851-aee0df7c01be tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:22.418521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-203e18a5-0e59-474b-8851-aee0df7c01be tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:22.419503 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-203e18a5-0e59-474b-8851-aee0df7c01be tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:22.420057 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-203e18a5-0e59-474b-8851-aee0df7c01be tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:22.629188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-203e18a5-0e59-474b-8851-aee0df7c01be tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:22.638111 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-203e18a5-0e59-474b-8851-aee0df7c01be tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1578 microversion: 2.1 time: 0.233985 Jul 20 11:46:22.647904 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 505/1020] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:22 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1578 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:23.428368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1c9210f1-8820-493c-874f-9a07aa7d4f54 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "POST /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.051824 Jul 20 11:46:23.429445 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 516/1021] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:46:22 2022] POST /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/os-volume_attachments => generated 194 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:46:23.657624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9ca14523-00b4-4b8b-b329-5d4ce9cc735b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:23.657624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9ca14523-00b4-4b8b-b329-5d4ce9cc735b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:23.663106 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ca14523-00b4-4b8b-b329-5d4ce9cc735b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:23.663794 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ca14523-00b4-4b8b-b329-5d4ce9cc735b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:23.664745 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ca14523-00b4-4b8b-b329-5d4ce9cc735b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:23.665364 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9ca14523-00b4-4b8b-b329-5d4ce9cc735b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:23.934382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-9ca14523-00b4-4b8b-b329-5d4ce9cc735b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:23.945729 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9ca14523-00b4-4b8b-b329-5d4ce9cc735b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1578 microversion: 2.1 time: 0.293970 Jul 20 11:46:23.956322 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 506/1022] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:23 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1578 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:24.425766 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-5f78f87e-3af0-40b9-a385-bda08b2585b0 req-ea2a8b0f-23f8-4ab6-9ede-9b0b8fc9d8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c040895-6702-44a4-9b5f-db96396f225b", "name": "network-vif-deleted", "tag": "98bd9704-51ee-4a9b-99c8-3ed18a4252e8"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:24.435351 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5f78f87e-3af0-40b9-a385-bda08b2585b0 req-ea2a8b0f-23f8-4ab6-9ede-9b0b8fc9d8c8 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:24.435351 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-5f78f87e-3af0-40b9-a385-bda08b2585b0 req-ea2a8b0f-23f8-4ab6-9ede-9b0b8fc9d8c8 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:24.452499 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-5f78f87e-3af0-40b9-a385-bda08b2585b0 req-ea2a8b0f-23f8-4ab6-9ede-9b0b8fc9d8c8 service nova] Creating event network-vif-deleted:98bd9704-51ee-4a9b-99c8-3ed18a4252e8 for instance 9c040895-6702-44a4-9b5f-db96396f225b on hv-cinder-82282 Jul 20 11:46:24.461083 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-5f78f87e-3af0-40b9-a385-bda08b2585b0 req-ea2a8b0f-23f8-4ab6-9ede-9b0b8fc9d8c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039619 Jul 20 11:46:24.467248 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 517/1023] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:46:24.962998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-aa991b96-a891-41db-aa2d-90d09b7f8224 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:24.963615 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-aa991b96-a891-41db-aa2d-90d09b7f8224 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:24.979537 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa991b96-a891-41db-aa2d-90d09b7f8224 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:24.980300 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa991b96-a891-41db-aa2d-90d09b7f8224 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:24.981151 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa991b96-a891-41db-aa2d-90d09b7f8224 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:24.981597 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-aa991b96-a891-41db-aa2d-90d09b7f8224 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:25.055281 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-aa991b96-a891-41db-aa2d-90d09b7f8224 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:25.063278 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-aa991b96-a891-41db-aa2d-90d09b7f8224 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 200 len: 1225 microversion: 2.1 time: 0.104462 Jul 20 11:46:25.067903 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 507/1024] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:24 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:25.199639 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-13fd52c6-46e4-472b-ae07-8c0e9bfb4e77 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:25.207013 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-13fd52c6-46e4-472b-ae07-8c0e9bfb4e77 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:25.211143 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13fd52c6-46e4-472b-ae07-8c0e9bfb4e77 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:25.211788 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13fd52c6-46e4-472b-ae07-8c0e9bfb4e77 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:25.213239 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13fd52c6-46e4-472b-ae07-8c0e9bfb4e77 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:25.213874 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13fd52c6-46e4-472b-ae07-8c0e9bfb4e77 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:25.237867 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-13fd52c6-46e4-472b-ae07-8c0e9bfb4e77 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lazy-loading 'flavor' on Instance uuid e38ac977-daa5-4751-a9e8-12c27706032e {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:46:25.803432 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-13fd52c6-46e4-472b-ae07-8c0e9bfb4e77 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "POST /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/action" status: 202 len: 0 microversion: 2.20 time: 0.608610 Jul 20 11:46:25.804449 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 518/1025] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jul 20 11:46:25 2022] POST /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:46:25.812693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bac41eb8-f47c-4761-b60e-800916ca3bac tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:25.814171 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bac41eb8-f47c-4761-b60e-800916ca3bac tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:25.821351 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bac41eb8-f47c-4761-b60e-800916ca3bac tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:25.822104 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bac41eb8-f47c-4761-b60e-800916ca3bac tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:25.823646 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bac41eb8-f47c-4761-b60e-800916ca3bac tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:25.825215 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bac41eb8-f47c-4761-b60e-800916ca3bac tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:26.001155 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bac41eb8-f47c-4761-b60e-800916ca3bac tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:26.010099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bac41eb8-f47c-4761-b60e-800916ca3bac tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:26.011850 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bac41eb8-f47c-4761-b60e-800916ca3bac tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:26.013226 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bac41eb8-f47c-4761-b60e-800916ca3bac tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.204401 Jul 20 11:46:26.013798 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 508/1026] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:25 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:46:26.084546 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-61eecae8-734e-47ef-ab11-80a340b8f712 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:26.085312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-61eecae8-734e-47ef-ab11-80a340b8f712 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:26.092521 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61eecae8-734e-47ef-ab11-80a340b8f712 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:26.092994 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61eecae8-734e-47ef-ab11-80a340b8f712 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:26.093761 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61eecae8-734e-47ef-ab11-80a340b8f712 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:26.094193 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61eecae8-734e-47ef-ab11-80a340b8f712 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:26.108710 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-61eecae8-734e-47ef-ab11-80a340b8f712 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] HTTP exception thrown: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-61eecae8-734e-47ef-ab11-80a340b8f712 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Request method failure captured: Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b HTTP/1.1 Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-ouaF6WimIu4HzQ3E-PrHMRS7kUMsJPti6PyGbALmVaApXIvJ9xGerM4bkmgPyiI4kUuKs27URM0LaOu6ld6XDAduO9rJThwNeFsY3C97ft6U0_y_yOcBMEdW8_oXVUXWOiktW-p0xvAjAxo2TSCBm0wahFhAM5bgdaGWBhLB6K1M8 Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: fb6890ad12fa47eeb3cc29dbec41dbe2 Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:46:26.110381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:46:26.112052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fb6890ad12fa47eeb3cc29dbec41dbe2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}] Jul 20 11:46:26.112052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:46:26.112052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: fb6890ad12fa47eeb3cc29dbec41dbe2 Jul 20 11:46:26.112052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:46:26.112052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-TestVolumeBootPattern-1794272804-project Jul 20 11:46:26.112052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:46:26.112052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:46:26.112052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: a32c5062f269416d9345c2ea2c6f85b6 Jul 20 11:46:26.112052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-TestVolumeBootPattern-1794272804-project Jul 20 11:46:26.112052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:46:26.112052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:46:26.112052 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': '9c040895-6702-44a4-9b5f-db96396f225b'} Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:46:26.122586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:46:26.124126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:46:26.125534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-61eecae8-734e-47ef-ab11-80a340b8f712 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Returning 404 to user: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:46:26.125534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-61eecae8-734e-47ef-ab11-80a340b8f712 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 404 len: 111 microversion: 2.1 time: 0.031762 Jul 20 11:46:26.125534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 519/1027] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:26 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:46:26.223176 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-260678548", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-443586517", "security_groups": [{"name": "tempest-secgroup-smoke-1035915013"}], "block_device_mapping_v2": [{"uuid": "5ff6fe89-81ac-4a9e-90ed-26592ea5f7b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6728c8a5-492f-4e81-8d8b-b2abdb951298"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:26.345645 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] validate_networks() for [('6728c8a5-492f-4e81-8d8b-b2abdb951298', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:46:26.758493 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:46:26.758910 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:46:26.759412 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:46:26.759812 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:46:26.760213 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:46:26.771528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:26.771975 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:26.773056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:26.773486 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:26.794328 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Getting quotas for project fb6890ad12fa47eeb3cc29dbec41dbe2. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:46:26.798667 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Getting quotas for user a32c5062f269416d9345c2ea2c6f85b6 and project fb6890ad12fa47eeb3cc29dbec41dbe2. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:46:26.860352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:46:26.862472 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ff6fe89-81ac-4a9e-90ed-26592ea5f7b2',volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:46:27.031964 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b2f7751a-ad64-44e2-be3f-941f4eb352c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:27.032658 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b2f7751a-ad64-44e2-be3f-941f4eb352c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:27.040430 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2f7751a-ad64-44e2-be3f-941f4eb352c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:27.044977 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2f7751a-ad64-44e2-be3f-941f4eb352c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:27.044977 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2f7751a-ad64-44e2-be3f-941f4eb352c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:27.044977 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b2f7751a-ad64-44e2-be3f-941f4eb352c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:27.206340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2f7751a-ad64-44e2-be3f-941f4eb352c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:27.215330 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2f7751a-ad64-44e2-be3f-941f4eb352c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:27.217064 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b2f7751a-ad64-44e2-be3f-941f4eb352c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:27.218468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b2f7751a-ad64-44e2-be3f-941f4eb352c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.190973 Jul 20 11:46:27.219020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 520/1028] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:27 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:27.307103 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f19798e7-6a0d-4d69-8632-81e663320fc8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.087756 Jul 20 11:46:27.312824 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 509/1029] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:46:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:46:27.328151 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-97347ef6-c1c0-45cb-b29f-6414462108bd tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:27.328588 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-97347ef6-c1c0-45cb-b29f-6414462108bd tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:27.392525 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-97347ef6-c1c0-45cb-b29f-6414462108bd tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:27.399288 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-97347ef6-c1c0-45cb-b29f-6414462108bd tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1093 microversion: 2.1 time: 0.075669 Jul 20 11:46:27.399873 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 521/1030] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:27 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:28.237877 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-101a775b-0b4f-48d0-9e2a-d23ef3592466 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:28.238597 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-101a775b-0b4f-48d0-9e2a-d23ef3592466 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:28.253949 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-101a775b-0b4f-48d0-9e2a-d23ef3592466 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:28.254661 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-101a775b-0b4f-48d0-9e2a-d23ef3592466 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:28.255520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-101a775b-0b4f-48d0-9e2a-d23ef3592466 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:28.255889 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-101a775b-0b4f-48d0-9e2a-d23ef3592466 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:28.417863 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-04ea5fee-3dd0-46ae-8483-79be9f874a44 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:28.418574 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-04ea5fee-3dd0-46ae-8483-79be9f874a44 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:28.419749 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-101a775b-0b4f-48d0-9e2a-d23ef3592466 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:28.427611 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04ea5fee-3dd0-46ae-8483-79be9f874a44 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:28.433267 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04ea5fee-3dd0-46ae-8483-79be9f874a44 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:28.433267 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04ea5fee-3dd0-46ae-8483-79be9f874a44 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:28.433267 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04ea5fee-3dd0-46ae-8483-79be9f874a44 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:28.433671 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-101a775b-0b4f-48d0-9e2a-d23ef3592466 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:28.433871 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-101a775b-0b4f-48d0-9e2a-d23ef3592466 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:28.435066 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-101a775b-0b4f-48d0-9e2a-d23ef3592466 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.201588 Jul 20 11:46:28.446961 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 510/1031] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:28 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:46:28.498123 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-04ea5fee-3dd0-46ae-8483-79be9f874a44 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:28.506354 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-04ea5fee-3dd0-46ae-8483-79be9f874a44 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1143 microversion: 2.1 time: 0.093568 Jul 20 11:46:28.515870 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 522/1032] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:28 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1143 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:46:29.454195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5bf50175-eaf0-427f-a763-46d9569668e5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:29.454911 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5bf50175-eaf0-427f-a763-46d9569668e5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:29.461667 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bf50175-eaf0-427f-a763-46d9569668e5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:29.462145 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bf50175-eaf0-427f-a763-46d9569668e5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:29.463639 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bf50175-eaf0-427f-a763-46d9569668e5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:29.464075 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5bf50175-eaf0-427f-a763-46d9569668e5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:29.523519 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f1d30290-baa1-48bf-ac69-0737a4d5d689 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:29.524099 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f1d30290-baa1-48bf-ac69-0737a4d5d689 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:29.531748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1d30290-baa1-48bf-ac69-0737a4d5d689 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:29.532475 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1d30290-baa1-48bf-ac69-0737a4d5d689 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:29.533486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1d30290-baa1-48bf-ac69-0737a4d5d689 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:29.534086 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f1d30290-baa1-48bf-ac69-0737a4d5d689 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:29.622576 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f1d30290-baa1-48bf-ac69-0737a4d5d689 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:29.642700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f1d30290-baa1-48bf-ac69-0737a4d5d689 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1199 microversion: 2.1 time: 0.122968 Jul 20 11:46:29.646448 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5bf50175-eaf0-427f-a763-46d9569668e5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:29.647218 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 523/1033] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:29 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1199 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:46:29.656203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5bf50175-eaf0-427f-a763-46d9569668e5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:29.658012 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5bf50175-eaf0-427f-a763-46d9569668e5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:29.659395 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5bf50175-eaf0-427f-a763-46d9569668e5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.209330 Jul 20 11:46:29.660079 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 511/1034] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:29 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:46:30.663976 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a94665bc-836b-4db6-b795-1df243705890 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:30.664694 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a94665bc-836b-4db6-b795-1df243705890 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:30.678382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a90c054b-2868-429c-b91a-d4d0a0a16aab tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:30.679090 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a90c054b-2868-429c-b91a-d4d0a0a16aab tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:30.689540 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a90c054b-2868-429c-b91a-d4d0a0a16aab tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:30.689905 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a90c054b-2868-429c-b91a-d4d0a0a16aab tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:30.690700 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a90c054b-2868-429c-b91a-d4d0a0a16aab tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:30.691134 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a90c054b-2868-429c-b91a-d4d0a0a16aab tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:30.697255 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a94665bc-836b-4db6-b795-1df243705890 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:30.697708 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a94665bc-836b-4db6-b795-1df243705890 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:30.698501 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a94665bc-836b-4db6-b795-1df243705890 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:30.698937 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a94665bc-836b-4db6-b795-1df243705890 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:30.891813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a94665bc-836b-4db6-b795-1df243705890 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:30.901713 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a94665bc-836b-4db6-b795-1df243705890 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1277 microversion: 2.1 time: 0.241891 Jul 20 11:46:30.902530 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 524/1035] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:30 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:30.915742 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a90c054b-2868-429c-b91a-d4d0a0a16aab tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:30.926197 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a90c054b-2868-429c-b91a-d4d0a0a16aab tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:30.927972 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a90c054b-2868-429c-b91a-d4d0a0a16aab tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:30.929407 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a90c054b-2868-429c-b91a-d4d0a0a16aab tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.254989 Jul 20 11:46:30.932324 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 512/1036] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:30 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:46:31.556652 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-e44360f5-652f-475d-9796-9f8d5cee410c req-bc03e493-2df0-49a4-b2d4-f84cde7a3521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a222c5a-9a05-425e-b301-8e79cdd760ce", "tag": "7b643c48-c2c5-421e-85ed-4923679b4e91"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:31.576200 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e44360f5-652f-475d-9796-9f8d5cee410c req-bc03e493-2df0-49a4-b2d4-f84cde7a3521 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:31.576691 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e44360f5-652f-475d-9796-9f8d5cee410c req-bc03e493-2df0-49a4-b2d4-f84cde7a3521 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:31.589909 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-e44360f5-652f-475d-9796-9f8d5cee410c req-bc03e493-2df0-49a4-b2d4-f84cde7a3521 service nova] Creating event network-changed:7b643c48-c2c5-421e-85ed-4923679b4e91 for instance 4a222c5a-9a05-425e-b301-8e79cdd760ce on hv-cinder-82282 Jul 20 11:46:31.596021 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-e44360f5-652f-475d-9796-9f8d5cee410c req-bc03e493-2df0-49a4-b2d4-f84cde7a3521 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044998 Jul 20 11:46:31.596644 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 525/1037] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:46:31.920082 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-59846605-d68e-49ca-8c1b-92b408b4113f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:31.920701 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-59846605-d68e-49ca-8c1b-92b408b4113f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:31.927409 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59846605-d68e-49ca-8c1b-92b408b4113f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:31.928074 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59846605-d68e-49ca-8c1b-92b408b4113f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:31.929624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59846605-d68e-49ca-8c1b-92b408b4113f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:31.930360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-59846605-d68e-49ca-8c1b-92b408b4113f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:31.950040 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a5a7ed6a-a247-4ff1-b9ca-aadfd826fb3d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:31.950739 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a5a7ed6a-a247-4ff1-b9ca-aadfd826fb3d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:31.957507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5a7ed6a-a247-4ff1-b9ca-aadfd826fb3d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:31.957958 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5a7ed6a-a247-4ff1-b9ca-aadfd826fb3d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:31.958813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5a7ed6a-a247-4ff1-b9ca-aadfd826fb3d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:31.959254 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a5a7ed6a-a247-4ff1-b9ca-aadfd826fb3d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:31.964362 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:32.126028 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-59846605-d68e-49ca-8c1b-92b408b4113f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:32.134977 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-59846605-d68e-49ca-8c1b-92b408b4113f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1277 microversion: 2.1 time: 0.219344 Jul 20 11:46:32.135632 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 513/1038] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:31 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:32.140636 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ab451862-83bb-4df2-b42f-9fa52ae4d878 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:32.147182 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab451862-83bb-4df2-b42f-9fa52ae4d878 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:32.147846 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ab451862-83bb-4df2-b42f-9fa52ae4d878 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:32.197495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a5a7ed6a-a247-4ff1-b9ca-aadfd826fb3d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:32.209489 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a5a7ed6a-a247-4ff1-b9ca-aadfd826fb3d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:32.211075 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a5a7ed6a-a247-4ff1-b9ca-aadfd826fb3d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:32.212927 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a5a7ed6a-a247-4ff1-b9ca-aadfd826fb3d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.267282 Jul 20 11:46:32.213819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 526/1039] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:31 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:32.213966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ab451862-83bb-4df2-b42f-9fa52ae4d878 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Going to try to stop instance {{(pid=124830) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 11:46:32.247929 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:32.365340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ab451862-83bb-4df2-b42f-9fa52ae4d878 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "POST /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/action" status: 202 len: 0 microversion: 2.1 time: 0.228010 Jul 20 11:46:32.366531 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 514/1040] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:46:32 2022] POST /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:46:32.375779 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-590b12c4-e3a1-45b6-a946-dee93d905b7b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:32.376581 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-590b12c4-e3a1-45b6-a946-dee93d905b7b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:32.382844 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-590b12c4-e3a1-45b6-a946-dee93d905b7b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:32.384495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-590b12c4-e3a1-45b6-a946-dee93d905b7b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:32.384495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-590b12c4-e3a1-45b6-a946-dee93d905b7b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:32.384698 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-590b12c4-e3a1-45b6-a946-dee93d905b7b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:32.518318 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-590b12c4-e3a1-45b6-a946-dee93d905b7b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:32.526120 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-590b12c4-e3a1-45b6-a946-dee93d905b7b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.154632 Jul 20 11:46:32.526698 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 527/1041] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:32 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:46:33.153609 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d55f6076-58c3-4341-9db7-2d374f7557ae tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:33.154216 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d55f6076-58c3-4341-9db7-2d374f7557ae tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:33.161049 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d55f6076-58c3-4341-9db7-2d374f7557ae tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:33.161491 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d55f6076-58c3-4341-9db7-2d374f7557ae tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:33.162248 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d55f6076-58c3-4341-9db7-2d374f7557ae tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:33.162675 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d55f6076-58c3-4341-9db7-2d374f7557ae tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:33.231506 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8b60a3d6-477c-4d0e-b7d8-201eaaf39409 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:33.232111 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8b60a3d6-477c-4d0e-b7d8-201eaaf39409 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:33.238720 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b60a3d6-477c-4d0e-b7d8-201eaaf39409 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:33.239165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b60a3d6-477c-4d0e-b7d8-201eaaf39409 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:33.239927 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b60a3d6-477c-4d0e-b7d8-201eaaf39409 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:33.240367 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8b60a3d6-477c-4d0e-b7d8-201eaaf39409 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:33.325103 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d55f6076-58c3-4341-9db7-2d374f7557ae tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:33.332380 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d55f6076-58c3-4341-9db7-2d374f7557ae tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1265 microversion: 2.1 time: 0.184325 Jul 20 11:46:33.332976 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 515/1042] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:33 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:33.387119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8b60a3d6-477c-4d0e-b7d8-201eaaf39409 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:33.394303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8b60a3d6-477c-4d0e-b7d8-201eaaf39409 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:33.395827 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8b60a3d6-477c-4d0e-b7d8-201eaaf39409 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:33.396999 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8b60a3d6-477c-4d0e-b7d8-201eaaf39409 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.169412 Jul 20 11:46:33.397554 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 528/1043] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:33 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:33.543946 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f17a2ac8-9e68-49b6-93ea-a4f202ca99ee tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:33.544552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f17a2ac8-9e68-49b6-93ea-a4f202ca99ee tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:33.550781 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f17a2ac8-9e68-49b6-93ea-a4f202ca99ee tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:33.551227 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f17a2ac8-9e68-49b6-93ea-a4f202ca99ee tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:33.551992 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f17a2ac8-9e68-49b6-93ea-a4f202ca99ee tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:33.552430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f17a2ac8-9e68-49b6-93ea-a4f202ca99ee tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:33.684987 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f17a2ac8-9e68-49b6-93ea-a4f202ca99ee tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:33.692892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f17a2ac8-9e68-49b6-93ea-a4f202ca99ee tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.152792 Jul 20 11:46:33.693462 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 516/1044] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:33 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:34.350159 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1b5e7637-4a13-4346-a1d1-fb657464e122 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:34.350782 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1b5e7637-4a13-4346-a1d1-fb657464e122 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:34.357301 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b5e7637-4a13-4346-a1d1-fb657464e122 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:34.357756 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b5e7637-4a13-4346-a1d1-fb657464e122 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:34.358527 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b5e7637-4a13-4346-a1d1-fb657464e122 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:34.358966 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1b5e7637-4a13-4346-a1d1-fb657464e122 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:34.415493 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dcfba09b-7806-4afe-bcf7-199bb883989f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:34.416122 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dcfba09b-7806-4afe-bcf7-199bb883989f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:34.422729 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcfba09b-7806-4afe-bcf7-199bb883989f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:34.423258 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcfba09b-7806-4afe-bcf7-199bb883989f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:34.424091 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcfba09b-7806-4afe-bcf7-199bb883989f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:34.424591 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dcfba09b-7806-4afe-bcf7-199bb883989f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:34.528991 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-1b5e7637-4a13-4346-a1d1-fb657464e122 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:34.536546 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1b5e7637-4a13-4346-a1d1-fb657464e122 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1265 microversion: 2.1 time: 0.190352 Jul 20 11:46:34.537159 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 529/1045] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:34 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:34.575537 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dcfba09b-7806-4afe-bcf7-199bb883989f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:34.583440 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dcfba09b-7806-4afe-bcf7-199bb883989f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:34.584965 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dcfba09b-7806-4afe-bcf7-199bb883989f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:34.586121 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dcfba09b-7806-4afe-bcf7-199bb883989f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.174680 Jul 20 11:46:34.586679 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 517/1046] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:34 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:34.710674 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9fe3ef26-4ac3-4e73-ac24-276550d0e373 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:34.711267 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9fe3ef26-4ac3-4e73-ac24-276550d0e373 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:34.718260 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9fe3ef26-4ac3-4e73-ac24-276550d0e373 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:34.718705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9fe3ef26-4ac3-4e73-ac24-276550d0e373 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:34.719469 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9fe3ef26-4ac3-4e73-ac24-276550d0e373 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:34.719899 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9fe3ef26-4ac3-4e73-ac24-276550d0e373 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:34.847332 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9fe3ef26-4ac3-4e73-ac24-276550d0e373 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:34.855703 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9fe3ef26-4ac3-4e73-ac24-276550d0e373 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.148962 Jul 20 11:46:34.856272 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 530/1047] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:34 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:35.552282 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5f63c072-b494-4f3a-8b3a-ea4f3bb38f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:35.552927 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5f63c072-b494-4f3a-8b3a-ea4f3bb38f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:35.560061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f63c072-b494-4f3a-8b3a-ea4f3bb38f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:35.560503 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f63c072-b494-4f3a-8b3a-ea4f3bb38f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:35.561290 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f63c072-b494-4f3a-8b3a-ea4f3bb38f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:35.561964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f63c072-b494-4f3a-8b3a-ea4f3bb38f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:35.603984 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e30dbe7d-770b-43b5-a37b-99e607d660cc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:35.604593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e30dbe7d-770b-43b5-a37b-99e607d660cc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:35.611053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e30dbe7d-770b-43b5-a37b-99e607d660cc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:35.611492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e30dbe7d-770b-43b5-a37b-99e607d660cc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:35.612258 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e30dbe7d-770b-43b5-a37b-99e607d660cc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:35.612689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e30dbe7d-770b-43b5-a37b-99e607d660cc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:35.737526 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f63c072-b494-4f3a-8b3a-ea4f3bb38f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:35.745654 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5f63c072-b494-4f3a-8b3a-ea4f3bb38f13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1265 microversion: 2.1 time: 0.197221 Jul 20 11:46:35.746385 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 518/1048] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:35 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:35.771247 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e30dbe7d-770b-43b5-a37b-99e607d660cc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:35.779530 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e30dbe7d-770b-43b5-a37b-99e607d660cc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:35.781066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e30dbe7d-770b-43b5-a37b-99e607d660cc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:35.782222 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e30dbe7d-770b-43b5-a37b-99e607d660cc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.182725 Jul 20 11:46:35.782778 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 531/1049] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:35 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:35.872805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d6842e43-f05b-48ad-8017-6857cac36ed5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:35.873417 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d6842e43-f05b-48ad-8017-6857cac36ed5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:35.879677 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6842e43-f05b-48ad-8017-6857cac36ed5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:35.880124 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6842e43-f05b-48ad-8017-6857cac36ed5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:35.880959 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6842e43-f05b-48ad-8017-6857cac36ed5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:35.881396 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d6842e43-f05b-48ad-8017-6857cac36ed5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:36.012723 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d6842e43-f05b-48ad-8017-6857cac36ed5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:36.020507 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d6842e43-f05b-48ad-8017-6857cac36ed5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.151638 Jul 20 11:46:36.021114 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 519/1050] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:35 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:36.762805 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9e1f419f-b218-45db-a515-3b1c43719f3b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:36.763408 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9e1f419f-b218-45db-a515-3b1c43719f3b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:36.770382 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e1f419f-b218-45db-a515-3b1c43719f3b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:36.770382 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e1f419f-b218-45db-a515-3b1c43719f3b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:36.771137 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e1f419f-b218-45db-a515-3b1c43719f3b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:36.771705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9e1f419f-b218-45db-a515-3b1c43719f3b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:36.801547 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-035364ac-8f0f-43a1-87a2-26bc639fdc0c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:36.802181 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-035364ac-8f0f-43a1-87a2-26bc639fdc0c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:36.804071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:36.807486 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:36.811290 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-035364ac-8f0f-43a1-87a2-26bc639fdc0c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:36.813668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-035364ac-8f0f-43a1-87a2-26bc639fdc0c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:36.813668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-035364ac-8f0f-43a1-87a2-26bc639fdc0c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:36.813668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-035364ac-8f0f-43a1-87a2-26bc639fdc0c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:36.967946 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9e1f419f-b218-45db-a515-3b1c43719f3b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:36.975214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9e1f419f-b218-45db-a515-3b1c43719f3b tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1265 microversion: 2.1 time: 0.216478 Jul 20 11:46:36.975789 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 532/1051] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:36 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:36.994057 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-035364ac-8f0f-43a1-87a2-26bc639fdc0c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:37.002659 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-035364ac-8f0f-43a1-87a2-26bc639fdc0c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:37.004169 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-035364ac-8f0f-43a1-87a2-26bc639fdc0c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:37.005360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-035364ac-8f0f-43a1-87a2-26bc639fdc0c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.207729 Jul 20 11:46:37.005916 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 520/1052] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:36 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:37.038376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c814cbe2-7961-4936-a7f2-60393f017a6e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:37.038928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c814cbe2-7961-4936-a7f2-60393f017a6e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:37.047548 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c814cbe2-7961-4936-a7f2-60393f017a6e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:37.048343 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c814cbe2-7961-4936-a7f2-60393f017a6e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:37.049737 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c814cbe2-7961-4936-a7f2-60393f017a6e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:37.050533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c814cbe2-7961-4936-a7f2-60393f017a6e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:37.198179 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c814cbe2-7961-4936-a7f2-60393f017a6e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:37.206807 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c814cbe2-7961-4936-a7f2-60393f017a6e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.172372 Jul 20 11:46:37.207504 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 533/1053] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:37 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:37.991499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5b3fe1e2-a1f2-459e-a552-fadd955ed2eb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:37.992101 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5b3fe1e2-a1f2-459e-a552-fadd955ed2eb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:37.999180 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b3fe1e2-a1f2-459e-a552-fadd955ed2eb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:37.999629 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b3fe1e2-a1f2-459e-a552-fadd955ed2eb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:38.000399 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b3fe1e2-a1f2-459e-a552-fadd955ed2eb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:38.000859 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5b3fe1e2-a1f2-459e-a552-fadd955ed2eb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:38.023721 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a23186cc-bf16-4514-a981-5716301ff53f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:38.024415 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a23186cc-bf16-4514-a981-5716301ff53f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:38.027239 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:38.032956 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a23186cc-bf16-4514-a981-5716301ff53f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:38.042231 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a23186cc-bf16-4514-a981-5716301ff53f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:38.042231 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a23186cc-bf16-4514-a981-5716301ff53f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:38.042231 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a23186cc-bf16-4514-a981-5716301ff53f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:38.192817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5b3fe1e2-a1f2-459e-a552-fadd955ed2eb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:38.200446 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5b3fe1e2-a1f2-459e-a552-fadd955ed2eb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1265 microversion: 2.1 time: 0.212830 Jul 20 11:46:38.201042 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 521/1054] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:37 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:38.213961 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a23186cc-bf16-4514-a981-5716301ff53f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:38.222200 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a23186cc-bf16-4514-a981-5716301ff53f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:38.223697 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a23186cc-bf16-4514-a981-5716301ff53f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:38.224251 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5472c77b-9eb2-457e-9873-aee8114906a7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:38.224889 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a23186cc-bf16-4514-a981-5716301ff53f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1745 microversion: 2.20 time: 0.205323 Jul 20 11:46:38.225015 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5472c77b-9eb2-457e-9873-aee8114906a7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:38.225440 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 534/1055] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:38 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1745 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:38.231550 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5472c77b-9eb2-457e-9873-aee8114906a7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:38.231992 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5472c77b-9eb2-457e-9873-aee8114906a7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:38.232756 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5472c77b-9eb2-457e-9873-aee8114906a7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:38.233214 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5472c77b-9eb2-457e-9873-aee8114906a7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:38.363314 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5472c77b-9eb2-457e-9873-aee8114906a7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:38.370726 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5472c77b-9eb2-457e-9873-aee8114906a7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.150248 Jul 20 11:46:38.371285 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 522/1056] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:38 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:46:39.217226 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2663c6d5-fd30-4122-93b0-cc8255ad2729 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:39.217797 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2663c6d5-fd30-4122-93b0-cc8255ad2729 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:39.224149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2663c6d5-fd30-4122-93b0-cc8255ad2729 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:39.224593 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2663c6d5-fd30-4122-93b0-cc8255ad2729 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:39.225385 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2663c6d5-fd30-4122-93b0-cc8255ad2729 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:39.225821 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2663c6d5-fd30-4122-93b0-cc8255ad2729 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:39.243387 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e84ad3db-6947-4fd9-bd36-91eb18187089 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:39.244648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e84ad3db-6947-4fd9-bd36-91eb18187089 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:39.251118 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e84ad3db-6947-4fd9-bd36-91eb18187089 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:39.251562 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e84ad3db-6947-4fd9-bd36-91eb18187089 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:39.252356 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e84ad3db-6947-4fd9-bd36-91eb18187089 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:39.252799 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e84ad3db-6947-4fd9-bd36-91eb18187089 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:39.433499 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2663c6d5-fd30-4122-93b0-cc8255ad2729 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:39.436401 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e84ad3db-6947-4fd9-bd36-91eb18187089 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:39.441141 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2663c6d5-fd30-4122-93b0-cc8255ad2729 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1265 microversion: 2.1 time: 0.227760 Jul 20 11:46:39.441720 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 535/1057] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:39 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:39.444541 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e84ad3db-6947-4fd9-bd36-91eb18187089 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:39.446077 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e84ad3db-6947-4fd9-bd36-91eb18187089 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:39.446228 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ddab33d3-e236-489a-8c64-7297b38790cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:39.446772 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ddab33d3-e236-489a-8c64-7297b38790cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:39.447296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e84ad3db-6947-4fd9-bd36-91eb18187089 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1745 microversion: 2.20 time: 0.207809 Jul 20 11:46:39.447895 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 523/1058] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:39 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1745 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:39.452943 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddab33d3-e236-489a-8c64-7297b38790cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:39.453416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddab33d3-e236-489a-8c64-7297b38790cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:39.454178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddab33d3-e236-489a-8c64-7297b38790cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:39.454643 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ddab33d3-e236-489a-8c64-7297b38790cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:39.581719 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ddab33d3-e236-489a-8c64-7297b38790cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:39.590094 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ddab33d3-e236-489a-8c64-7297b38790cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.147457 Jul 20 11:46:39.590655 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 536/1059] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:39 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:40.457856 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b3ae47d4-aa59-4190-9e92-aa7ebccfab16 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:40.458439 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b3ae47d4-aa59-4190-9e92-aa7ebccfab16 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:40.465408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3ae47d4-aa59-4190-9e92-aa7ebccfab16 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:40.466653 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3ae47d4-aa59-4190-9e92-aa7ebccfab16 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:40.467576 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3ae47d4-aa59-4190-9e92-aa7ebccfab16 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:40.468012 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b3ae47d4-aa59-4190-9e92-aa7ebccfab16 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:40.468431 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5dd5da18-0719-454e-bebe-07be05645642 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:40.469087 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5dd5da18-0719-454e-bebe-07be05645642 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:40.475433 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dd5da18-0719-454e-bebe-07be05645642 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:40.478763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dd5da18-0719-454e-bebe-07be05645642 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:40.478763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dd5da18-0719-454e-bebe-07be05645642 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:40.478763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dd5da18-0719-454e-bebe-07be05645642 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:40.710810 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b3ae47d4-aa59-4190-9e92-aa7ebccfab16 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:40.716125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5dd5da18-0719-454e-bebe-07be05645642 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:40.719733 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b3ae47d4-aa59-4190-9e92-aa7ebccfab16 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1265 microversion: 2.1 time: 0.265711 Jul 20 11:46:40.720857 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 524/1060] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:40 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:46:40.725236 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-45252d4e-7285-4579-8460-2a4805e27ab8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:40.725945 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-45252d4e-7285-4579-8460-2a4805e27ab8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:40.735747 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5dd5da18-0719-454e-bebe-07be05645642 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:40.736170 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45252d4e-7285-4579-8460-2a4805e27ab8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:40.737415 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45252d4e-7285-4579-8460-2a4805e27ab8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:40.737558 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45252d4e-7285-4579-8460-2a4805e27ab8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:40.738024 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-45252d4e-7285-4579-8460-2a4805e27ab8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:40.738974 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5dd5da18-0719-454e-bebe-07be05645642 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:40.740337 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5dd5da18-0719-454e-bebe-07be05645642 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1745 microversion: 2.20 time: 0.278606 Jul 20 11:46:40.749151 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 537/1061] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:40 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1745 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:40.897208 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-45252d4e-7285-4579-8460-2a4805e27ab8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:40.908825 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-45252d4e-7285-4579-8460-2a4805e27ab8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.187192 Jul 20 11:46:40.909406 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 525/1062] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:40 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:41.736812 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ae8f9395-72d6-4553-b79f-8ef7292d7bcb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:41.737434 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ae8f9395-72d6-4553-b79f-8ef7292d7bcb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:41.743817 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae8f9395-72d6-4553-b79f-8ef7292d7bcb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:41.744278 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae8f9395-72d6-4553-b79f-8ef7292d7bcb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:41.745063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae8f9395-72d6-4553-b79f-8ef7292d7bcb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:41.745490 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ae8f9395-72d6-4553-b79f-8ef7292d7bcb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:41.762035 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c4191a80-c6b5-42d5-8afb-bc334bb0363e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:41.762648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c4191a80-c6b5-42d5-8afb-bc334bb0363e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:41.769143 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4191a80-c6b5-42d5-8afb-bc334bb0363e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:41.769588 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4191a80-c6b5-42d5-8afb-bc334bb0363e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:41.770356 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4191a80-c6b5-42d5-8afb-bc334bb0363e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:41.770788 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c4191a80-c6b5-42d5-8afb-bc334bb0363e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:41.944078 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ae8f9395-72d6-4553-b79f-8ef7292d7bcb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:41.952412 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ae8f9395-72d6-4553-b79f-8ef7292d7bcb tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1265 microversion: 2.1 time: 0.219456 Jul 20 11:46:41.953027 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 538/1063] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:41 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:41.957442 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f63fcea8-8c20-41e2-a485-12c6b5b54061 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:41.958046 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f63fcea8-8c20-41e2-a485-12c6b5b54061 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:41.963774 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f63fcea8-8c20-41e2-a485-12c6b5b54061 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:41.964228 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f63fcea8-8c20-41e2-a485-12c6b5b54061 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:41.965032 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f63fcea8-8c20-41e2-a485-12c6b5b54061 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:41.965473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f63fcea8-8c20-41e2-a485-12c6b5b54061 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:41.982472 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c4191a80-c6b5-42d5-8afb-bc334bb0363e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:41.993299 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c4191a80-c6b5-42d5-8afb-bc334bb0363e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:41.995270 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c4191a80-c6b5-42d5-8afb-bc334bb0363e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:41.996437 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c4191a80-c6b5-42d5-8afb-bc334bb0363e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1745 microversion: 2.20 time: 0.238845 Jul 20 11:46:41.997102 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 526/1064] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:41 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1745 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:42.100604 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f63fcea8-8c20-41e2-a485-12c6b5b54061 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:42.109446 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f63fcea8-8c20-41e2-a485-12c6b5b54061 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.155459 Jul 20 11:46:42.110024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 539/1065] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:41 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:42.713992 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-dea11e25-fc32-4f86-88ea-e85b3dfbabfb req-70a56833-7748-41b0-9858-2fb9357e5f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38ac977-daa5-4751-a9e8-12c27706032e", "name": "network-vif-plugged", "status": "completed", "tag": "98fc8e3d-93c5-45a0-9829-77da42ba8ac3"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:42.722341 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-dea11e25-fc32-4f86-88ea-e85b3dfbabfb req-70a56833-7748-41b0-9858-2fb9357e5f7e service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:42.722789 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-dea11e25-fc32-4f86-88ea-e85b3dfbabfb req-70a56833-7748-41b0-9858-2fb9357e5f7e service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:42.735782 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-dea11e25-fc32-4f86-88ea-e85b3dfbabfb req-70a56833-7748-41b0-9858-2fb9357e5f7e service nova] Creating event network-vif-plugged:98fc8e3d-93c5-45a0-9829-77da42ba8ac3 for instance e38ac977-daa5-4751-a9e8-12c27706032e on hv-cinder-82282 Jul 20 11:46:42.740911 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-dea11e25-fc32-4f86-88ea-e85b3dfbabfb req-70a56833-7748-41b0-9858-2fb9357e5f7e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031286 Jul 20 11:46:42.741488 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 527/1066] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:46:42.969493 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-62cca184-775d-460d-8b0b-e671b6c1360e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:42.970110 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-62cca184-775d-460d-8b0b-e671b6c1360e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:42.976564 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62cca184-775d-460d-8b0b-e671b6c1360e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:42.977069 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62cca184-775d-460d-8b0b-e671b6c1360e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:42.977828 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62cca184-775d-460d-8b0b-e671b6c1360e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:42.978283 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-62cca184-775d-460d-8b0b-e671b6c1360e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:43.016462 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-28d883c8-eb9c-4b71-8657-462ecf1c03ae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:43.017173 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-28d883c8-eb9c-4b71-8657-462ecf1c03ae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:43.023834 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28d883c8-eb9c-4b71-8657-462ecf1c03ae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:43.024285 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28d883c8-eb9c-4b71-8657-462ecf1c03ae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:43.025673 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28d883c8-eb9c-4b71-8657-462ecf1c03ae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:43.026111 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-28d883c8-eb9c-4b71-8657-462ecf1c03ae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:43.160329 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-62cca184-775d-460d-8b0b-e671b6c1360e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:43.167739 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-62cca184-775d-460d-8b0b-e671b6c1360e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1265 microversion: 2.1 time: 0.202045 Jul 20 11:46:43.168251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 540/1067] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:42 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:43.172960 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6349408c-d53b-44e6-b656-ad4235ac68d4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:43.173559 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6349408c-d53b-44e6-b656-ad4235ac68d4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:43.179370 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6349408c-d53b-44e6-b656-ad4235ac68d4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:43.179815 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6349408c-d53b-44e6-b656-ad4235ac68d4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:43.180580 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6349408c-d53b-44e6-b656-ad4235ac68d4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:43.181074 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6349408c-d53b-44e6-b656-ad4235ac68d4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:43.189430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-28d883c8-eb9c-4b71-8657-462ecf1c03ae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:43.197904 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-28d883c8-eb9c-4b71-8657-462ecf1c03ae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:43.199423 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-28d883c8-eb9c-4b71-8657-462ecf1c03ae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:43.200620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-28d883c8-eb9c-4b71-8657-462ecf1c03ae tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1745 microversion: 2.20 time: 0.188457 Jul 20 11:46:43.201227 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 528/1068] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:43 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:43.310014 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6349408c-d53b-44e6-b656-ad4235ac68d4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:43.318398 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6349408c-d53b-44e6-b656-ad4235ac68d4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.149180 Jul 20 11:46:43.319016 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 541/1069] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:43 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:44.185676 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7dc48861-99f8-4021-8c0f-3437b88e920f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:44.188120 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7dc48861-99f8-4021-8c0f-3437b88e920f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:44.192960 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dc48861-99f8-4021-8c0f-3437b88e920f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:44.193444 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dc48861-99f8-4021-8c0f-3437b88e920f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:44.194222 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dc48861-99f8-4021-8c0f-3437b88e920f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:44.194660 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7dc48861-99f8-4021-8c0f-3437b88e920f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:44.219600 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fa15f385-b477-491b-a85e-85b13db47744 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:44.220323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fa15f385-b477-491b-a85e-85b13db47744 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:44.227862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa15f385-b477-491b-a85e-85b13db47744 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:44.228910 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa15f385-b477-491b-a85e-85b13db47744 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:44.229920 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa15f385-b477-491b-a85e-85b13db47744 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:44.230353 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fa15f385-b477-491b-a85e-85b13db47744 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:44.398952 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7dc48861-99f8-4021-8c0f-3437b88e920f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:44.414883 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7dc48861-99f8-4021-8c0f-3437b88e920f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1265 microversion: 2.1 time: 0.227588 Jul 20 11:46:44.417063 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 529/1070] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:44 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:44.422897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c8377a5f-3856-4473-9106-31a8e99a36eb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:44.423503 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c8377a5f-3856-4473-9106-31a8e99a36eb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:44.426416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fa15f385-b477-491b-a85e-85b13db47744 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:44.429756 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8377a5f-3856-4473-9106-31a8e99a36eb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:44.430201 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8377a5f-3856-4473-9106-31a8e99a36eb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:44.430678 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:44.430979 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8377a5f-3856-4473-9106-31a8e99a36eb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:44.431445 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8377a5f-3856-4473-9106-31a8e99a36eb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:44.436869 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fa15f385-b477-491b-a85e-85b13db47744 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:44.439381 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fa15f385-b477-491b-a85e-85b13db47744 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:44.441043 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fa15f385-b477-491b-a85e-85b13db47744 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1740 microversion: 2.20 time: 0.225293 Jul 20 11:46:44.443387 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 542/1071] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:44 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:44.598469 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c8377a5f-3856-4473-9106-31a8e99a36eb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:44.607980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c8377a5f-3856-4473-9106-31a8e99a36eb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.188702 Jul 20 11:46:44.608736 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 530/1072] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:44 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:44.755636 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-8434c6ad-41a8-4317-8176-0a9e3274b2e7 req-a10c5e0b-6799-44e9-94b1-65c409bd7a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a222c5a-9a05-425e-b301-8e79cdd760ce", "name": "network-vif-plugged", "status": "completed", "tag": "7b643c48-c2c5-421e-85ed-4923679b4e91"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:44.765330 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8434c6ad-41a8-4317-8176-0a9e3274b2e7 req-a10c5e0b-6799-44e9-94b1-65c409bd7a03 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:44.765778 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8434c6ad-41a8-4317-8176-0a9e3274b2e7 req-a10c5e0b-6799-44e9-94b1-65c409bd7a03 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:44.780002 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-8434c6ad-41a8-4317-8176-0a9e3274b2e7 req-a10c5e0b-6799-44e9-94b1-65c409bd7a03 service nova] Creating event network-vif-plugged:7b643c48-c2c5-421e-85ed-4923679b4e91 for instance 4a222c5a-9a05-425e-b301-8e79cdd760ce on hv-cinder-82282 Jul 20 11:46:44.785162 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-8434c6ad-41a8-4317-8176-0a9e3274b2e7 req-a10c5e0b-6799-44e9-94b1-65c409bd7a03 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033283 Jul 20 11:46:44.785934 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 543/1073] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:46:45.433466 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-07e8ce06-38c8-4a7e-8e1d-0a8011ee1c07 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:45.434765 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-07e8ce06-38c8-4a7e-8e1d-0a8011ee1c07 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:45.437443 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:45.442627 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07e8ce06-38c8-4a7e-8e1d-0a8011ee1c07 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:45.443380 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07e8ce06-38c8-4a7e-8e1d-0a8011ee1c07 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:45.444411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07e8ce06-38c8-4a7e-8e1d-0a8011ee1c07 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:45.444873 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07e8ce06-38c8-4a7e-8e1d-0a8011ee1c07 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:45.471095 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c1e49590-ef1a-452f-b09d-cadb9efa6259 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:45.472119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c1e49590-ef1a-452f-b09d-cadb9efa6259 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:45.485069 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1e49590-ef1a-452f-b09d-cadb9efa6259 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:45.485864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1e49590-ef1a-452f-b09d-cadb9efa6259 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:45.494723 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1e49590-ef1a-452f-b09d-cadb9efa6259 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:45.494723 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c1e49590-ef1a-452f-b09d-cadb9efa6259 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:45.666423 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-07e8ce06-38c8-4a7e-8e1d-0a8011ee1c07 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:45.672179 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:45.683657 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-07e8ce06-38c8-4a7e-8e1d-0a8011ee1c07 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1265 microversion: 2.1 time: 0.252442 Jul 20 11:46:45.685431 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 531/1074] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:45 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:45.698347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1b760374-35a8-497c-adfa-704f1748bc6b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:45.699341 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1b760374-35a8-497c-adfa-704f1748bc6b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:45.707592 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b760374-35a8-497c-adfa-704f1748bc6b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:45.708566 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b760374-35a8-497c-adfa-704f1748bc6b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:45.709488 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b760374-35a8-497c-adfa-704f1748bc6b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:45.710025 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1b760374-35a8-497c-adfa-704f1748bc6b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:45.717466 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c1e49590-ef1a-452f-b09d-cadb9efa6259 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:45.726655 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c1e49590-ef1a-452f-b09d-cadb9efa6259 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:45.728811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-c1e49590-ef1a-452f-b09d-cadb9efa6259 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:45.730063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c1e49590-ef1a-452f-b09d-cadb9efa6259 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1740 microversion: 2.20 time: 0.266261 Jul 20 11:46:45.736826 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 544/1075] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:45 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:45.875446 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1b760374-35a8-497c-adfa-704f1748bc6b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:45.883757 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1b760374-35a8-497c-adfa-704f1748bc6b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.196263 Jul 20 11:46:45.884561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 532/1076] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:45 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:46.701344 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9535f901-5dbc-4511-9304-12cc716e6ae6 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:46.701947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9535f901-5dbc-4511-9304-12cc716e6ae6 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:46.704388 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:46:46.709210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9535f901-5dbc-4511-9304-12cc716e6ae6 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:46.709659 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9535f901-5dbc-4511-9304-12cc716e6ae6 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:46.710422 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9535f901-5dbc-4511-9304-12cc716e6ae6 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:46.710848 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9535f901-5dbc-4511-9304-12cc716e6ae6 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:46.749271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a0ab34e6-a9c7-41a2-b278-30a30513405c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:46.754528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a0ab34e6-a9c7-41a2-b278-30a30513405c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:46.761107 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0ab34e6-a9c7-41a2-b278-30a30513405c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:46.766378 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0ab34e6-a9c7-41a2-b278-30a30513405c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:46.767277 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0ab34e6-a9c7-41a2-b278-30a30513405c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:46.767792 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a0ab34e6-a9c7-41a2-b278-30a30513405c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:46.942694 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9535f901-5dbc-4511-9304-12cc716e6ae6 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:46.951210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9535f901-5dbc-4511-9304-12cc716e6ae6 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1265 microversion: 2.1 time: 0.254275 Jul 20 11:46:46.951914 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 545/1077] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:46 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:46.957724 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ecdd46ea-4f2f-4723-99d1-9e592461228a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:46.958435 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ecdd46ea-4f2f-4723-99d1-9e592461228a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:46.965627 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ecdd46ea-4f2f-4723-99d1-9e592461228a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:46.966183 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ecdd46ea-4f2f-4723-99d1-9e592461228a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:46.967170 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ecdd46ea-4f2f-4723-99d1-9e592461228a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:46.967687 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ecdd46ea-4f2f-4723-99d1-9e592461228a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:46.995545 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a0ab34e6-a9c7-41a2-b278-30a30513405c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:47.000980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a0ab34e6-a9c7-41a2-b278-30a30513405c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:47.002954 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a0ab34e6-a9c7-41a2-b278-30a30513405c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:47.004373 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a0ab34e6-a9c7-41a2-b278-30a30513405c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1740 microversion: 2.20 time: 0.259235 Jul 20 11:46:47.016356 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 533/1078] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:46 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:46:47.120010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ecdd46ea-4f2f-4723-99d1-9e592461228a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:47.128831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ecdd46ea-4f2f-4723-99d1-9e592461228a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.175590 Jul 20 11:46:47.129434 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 546/1079] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:46 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:47.969883 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d29fe76c-8720-4478-ad02-eb7c9f564dec tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:47.970657 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d29fe76c-8720-4478-ad02-eb7c9f564dec tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:47.979603 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d29fe76c-8720-4478-ad02-eb7c9f564dec tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:47.980138 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d29fe76c-8720-4478-ad02-eb7c9f564dec tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:47.981309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d29fe76c-8720-4478-ad02-eb7c9f564dec tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:47.981978 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d29fe76c-8720-4478-ad02-eb7c9f564dec tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:48.032066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b1775b79-1af8-4314-8a1b-87ddbe3ad9c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:48.032868 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b1775b79-1af8-4314-8a1b-87ddbe3ad9c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:48.044875 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1775b79-1af8-4314-8a1b-87ddbe3ad9c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:48.049784 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1775b79-1af8-4314-8a1b-87ddbe3ad9c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:48.050622 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1775b79-1af8-4314-8a1b-87ddbe3ad9c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:48.051062 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b1775b79-1af8-4314-8a1b-87ddbe3ad9c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:48.282726 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d29fe76c-8720-4478-ad02-eb7c9f564dec tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:48.291868 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d29fe76c-8720-4478-ad02-eb7c9f564dec tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1453 microversion: 2.1 time: 0.326958 Jul 20 11:46:48.292442 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 534/1080] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:47 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1453 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:48.297547 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ae085e03-e743-46b1-920f-f0f889078c57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:48.298131 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ae085e03-e743-46b1-920f-f0f889078c57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:48.304141 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1775b79-1af8-4314-8a1b-87ddbe3ad9c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:48.313589 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1775b79-1af8-4314-8a1b-87ddbe3ad9c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:48.315065 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b1775b79-1af8-4314-8a1b-87ddbe3ad9c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:48.316213 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b1775b79-1af8-4314-8a1b-87ddbe3ad9c5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1740 microversion: 2.20 time: 0.296338 Jul 20 11:46:48.316971 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 547/1081] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:48 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1740 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:46:48.325898 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae085e03-e743-46b1-920f-f0f889078c57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:48.326337 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae085e03-e743-46b1-920f-f0f889078c57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:48.327117 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae085e03-e743-46b1-920f-f0f889078c57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:48.327628 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ae085e03-e743-46b1-920f-f0f889078c57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:48.333007 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-49a80276-127e-43d5-a1aa-02f034ca4ef8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:48.333007 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-49a80276-127e-43d5-a1aa-02f034ca4ef8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:48.339570 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49a80276-127e-43d5-a1aa-02f034ca4ef8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:48.340020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49a80276-127e-43d5-a1aa-02f034ca4ef8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:48.340817 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49a80276-127e-43d5-a1aa-02f034ca4ef8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:48.341250 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-49a80276-127e-43d5-a1aa-02f034ca4ef8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:48.531467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ae085e03-e743-46b1-920f-f0f889078c57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:48.541236 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ae085e03-e743-46b1-920f-f0f889078c57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.247219 Jul 20 11:46:48.542147 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 535/1082] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:48 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:48.548203 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-49a80276-127e-43d5-a1aa-02f034ca4ef8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:48.557524 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-49a80276-127e-43d5-a1aa-02f034ca4ef8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1453 microversion: 2.1 time: 0.239704 Jul 20 11:46:48.561122 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 548/1083] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:48 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1453 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:49.335096 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e6ae5577-d2d1-4d95-abb8-b52780d40a25 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:49.336514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e6ae5577-d2d1-4d95-abb8-b52780d40a25 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:49.344390 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6ae5577-d2d1-4d95-abb8-b52780d40a25 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:49.345204 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6ae5577-d2d1-4d95-abb8-b52780d40a25 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:49.346390 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6ae5577-d2d1-4d95-abb8-b52780d40a25 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:49.347066 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e6ae5577-d2d1-4d95-abb8-b52780d40a25 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:49.501403 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e6ae5577-d2d1-4d95-abb8-b52780d40a25 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:49.511157 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e6ae5577-d2d1-4d95-abb8-b52780d40a25 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:49.512862 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e6ae5577-d2d1-4d95-abb8-b52780d40a25 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:49.514317 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e6ae5577-d2d1-4d95-abb8-b52780d40a25 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1740 microversion: 2.20 time: 0.183456 Jul 20 11:46:49.525539 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 536/1084] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:49 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:46:49.560812 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7e0ad2bf-7656-46c7-a847-daf74a0d32cc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:49.561456 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7e0ad2bf-7656-46c7-a847-daf74a0d32cc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:49.571112 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e0ad2bf-7656-46c7-a847-daf74a0d32cc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:49.572166 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e0ad2bf-7656-46c7-a847-daf74a0d32cc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:49.573338 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e0ad2bf-7656-46c7-a847-daf74a0d32cc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:49.574105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7e0ad2bf-7656-46c7-a847-daf74a0d32cc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:49.774589 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7e0ad2bf-7656-46c7-a847-daf74a0d32cc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:49.785873 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7e0ad2bf-7656-46c7-a847-daf74a0d32cc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.231242 Jul 20 11:46:49.787079 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 549/1085] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:49 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:50.534305 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-48060761-30a5-4848-8f32-e54f016eeafb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:50.535024 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-48060761-30a5-4848-8f32-e54f016eeafb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:50.543198 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48060761-30a5-4848-8f32-e54f016eeafb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:50.543198 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48060761-30a5-4848-8f32-e54f016eeafb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:50.543819 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48060761-30a5-4848-8f32-e54f016eeafb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:50.544249 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-48060761-30a5-4848-8f32-e54f016eeafb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:50.688853 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-48060761-30a5-4848-8f32-e54f016eeafb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:50.696889 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-48060761-30a5-4848-8f32-e54f016eeafb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:50.698679 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-48060761-30a5-4848-8f32-e54f016eeafb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:50.699860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-48060761-30a5-4848-8f32-e54f016eeafb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1740 microversion: 2.20 time: 0.169738 Jul 20 11:46:50.700430 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 537/1086] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:50 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:46:50.804107 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eb2ae66f-c513-451c-8707-2d1fd7652f5b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:50.805645 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eb2ae66f-c513-451c-8707-2d1fd7652f5b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:50.812364 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb2ae66f-c513-451c-8707-2d1fd7652f5b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:50.812851 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb2ae66f-c513-451c-8707-2d1fd7652f5b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:50.813646 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb2ae66f-c513-451c-8707-2d1fd7652f5b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:50.814084 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb2ae66f-c513-451c-8707-2d1fd7652f5b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:50.956753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eb2ae66f-c513-451c-8707-2d1fd7652f5b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:50.964947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eb2ae66f-c513-451c-8707-2d1fd7652f5b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.165311 Jul 20 11:46:50.965522 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 550/1087] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:50 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:51.051538 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-3faa6927-985f-40f1-b3b6-fe68351bcee7 req-efae10d1-10f0-454f-8c91-dcfad1282945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a222c5a-9a05-425e-b301-8e79cdd760ce", "tag": "7b643c48-c2c5-421e-85ed-4923679b4e91"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:51.077941 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3faa6927-985f-40f1-b3b6-fe68351bcee7 req-efae10d1-10f0-454f-8c91-dcfad1282945 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:51.078918 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-3faa6927-985f-40f1-b3b6-fe68351bcee7 req-efae10d1-10f0-454f-8c91-dcfad1282945 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:51.101696 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-3faa6927-985f-40f1-b3b6-fe68351bcee7 req-efae10d1-10f0-454f-8c91-dcfad1282945 service nova] Creating event network-changed:7b643c48-c2c5-421e-85ed-4923679b4e91 for instance 4a222c5a-9a05-425e-b301-8e79cdd760ce on hv-cinder-82282 Jul 20 11:46:51.108937 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-3faa6927-985f-40f1-b3b6-fe68351bcee7 req-efae10d1-10f0-454f-8c91-dcfad1282945 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062632 Jul 20 11:46:51.109850 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 538/1088] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:46:51.718754 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3647dd53-7f1a-4d33-aa2b-b2db9c76fd7f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:51.719744 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3647dd53-7f1a-4d33-aa2b-b2db9c76fd7f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:51.726834 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3647dd53-7f1a-4d33-aa2b-b2db9c76fd7f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:51.729718 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3647dd53-7f1a-4d33-aa2b-b2db9c76fd7f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:51.732815 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3647dd53-7f1a-4d33-aa2b-b2db9c76fd7f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:51.733501 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3647dd53-7f1a-4d33-aa2b-b2db9c76fd7f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:51.917082 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3647dd53-7f1a-4d33-aa2b-b2db9c76fd7f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:51.927469 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3647dd53-7f1a-4d33-aa2b-b2db9c76fd7f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:51.929168 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3647dd53-7f1a-4d33-aa2b-b2db9c76fd7f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:51.930366 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3647dd53-7f1a-4d33-aa2b-b2db9c76fd7f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1740 microversion: 2.20 time: 0.215539 Jul 20 11:46:51.935725 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 551/1089] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:51 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:46:51.983436 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0ed3d6b6-e99d-4d02-ae5c-2320cc357a0c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:51.984169 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0ed3d6b6-e99d-4d02-ae5c-2320cc357a0c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:51.990496 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ed3d6b6-e99d-4d02-ae5c-2320cc357a0c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:51.990936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ed3d6b6-e99d-4d02-ae5c-2320cc357a0c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:51.991706 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ed3d6b6-e99d-4d02-ae5c-2320cc357a0c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:51.992127 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ed3d6b6-e99d-4d02-ae5c-2320cc357a0c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:52.139830 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-0ed3d6b6-e99d-4d02-ae5c-2320cc357a0c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:52.148872 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0ed3d6b6-e99d-4d02-ae5c-2320cc357a0c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1721 microversion: 2.1 time: 0.169872 Jul 20 11:46:52.159892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 539/1090] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:51 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:52.950414 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-56b80cc8-8b2a-4511-8818-6215e2a9d918 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:52.952432 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-56b80cc8-8b2a-4511-8818-6215e2a9d918 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:52.963798 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56b80cc8-8b2a-4511-8818-6215e2a9d918 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:52.964588 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56b80cc8-8b2a-4511-8818-6215e2a9d918 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:52.965578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56b80cc8-8b2a-4511-8818-6215e2a9d918 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:52.966364 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-56b80cc8-8b2a-4511-8818-6215e2a9d918 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:53.117660 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-56b80cc8-8b2a-4511-8818-6215e2a9d918 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:53.126686 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-56b80cc8-8b2a-4511-8818-6215e2a9d918 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:53.128386 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-56b80cc8-8b2a-4511-8818-6215e2a9d918 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:53.129683 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-56b80cc8-8b2a-4511-8818-6215e2a9d918 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1740 microversion: 2.20 time: 0.184342 Jul 20 11:46:53.130938 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 552/1091] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:52 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:46:53.167309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3c7da1ae-7749-4f72-a7f3-d36be1fc1deb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:53.167924 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3c7da1ae-7749-4f72-a7f3-d36be1fc1deb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:53.174747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c7da1ae-7749-4f72-a7f3-d36be1fc1deb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:53.176265 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c7da1ae-7749-4f72-a7f3-d36be1fc1deb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:53.176265 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c7da1ae-7749-4f72-a7f3-d36be1fc1deb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:53.176487 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c7da1ae-7749-4f72-a7f3-d36be1fc1deb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:53.321433 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3c7da1ae-7749-4f72-a7f3-d36be1fc1deb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:53.329930 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3c7da1ae-7749-4f72-a7f3-d36be1fc1deb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1698 microversion: 2.1 time: 0.167017 Jul 20 11:46:53.342194 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 540/1092] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:53 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:53.348446 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-dd4b36b9-4324-4e4a-9d19-12555505af7e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:46:53.355548 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd4b36b9-4324-4e4a-9d19-12555505af7e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:53.356305 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-dd4b36b9-4324-4e4a-9d19-12555505af7e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:53.418883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-dd4b36b9-4324-4e4a-9d19-12555505af7e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Going to try to start instance {{(pid=124831) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 11:46:53.576524 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-dd4b36b9-4324-4e4a-9d19-12555505af7e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "POST /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/action" status: 202 len: 0 microversion: 2.1 time: 0.231740 Jul 20 11:46:53.577492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 553/1093] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:46:53 2022] POST /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:46:53.585585 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e46a0862-4d76-43d2-bbe0-7c40bb34a274 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:53.586578 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e46a0862-4d76-43d2-bbe0-7c40bb34a274 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:53.593545 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e46a0862-4d76-43d2-bbe0-7c40bb34a274 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:53.594109 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e46a0862-4d76-43d2-bbe0-7c40bb34a274 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:53.594973 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e46a0862-4d76-43d2-bbe0-7c40bb34a274 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:53.595538 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e46a0862-4d76-43d2-bbe0-7c40bb34a274 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:54.013290 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e46a0862-4d76-43d2-bbe0-7c40bb34a274 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:54.023354 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e46a0862-4d76-43d2-bbe0-7c40bb34a274 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1707 microversion: 2.1 time: 0.441438 Jul 20 11:46:54.024159 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 541/1094] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:53 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1707 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:54.152670 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cd7e8e2c-76df-477a-b214-763f2be20bde tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:54.154141 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cd7e8e2c-76df-477a-b214-763f2be20bde tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:54.164133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd7e8e2c-76df-477a-b214-763f2be20bde tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:54.164589 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd7e8e2c-76df-477a-b214-763f2be20bde tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:54.165994 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd7e8e2c-76df-477a-b214-763f2be20bde tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:54.166443 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cd7e8e2c-76df-477a-b214-763f2be20bde tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:54.310768 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cd7e8e2c-76df-477a-b214-763f2be20bde tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:54.318784 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cd7e8e2c-76df-477a-b214-763f2be20bde tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:54.322735 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cd7e8e2c-76df-477a-b214-763f2be20bde tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:54.322735 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cd7e8e2c-76df-477a-b214-763f2be20bde tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1740 microversion: 2.20 time: 0.175477 Jul 20 11:46:54.322735 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 554/1095] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:54 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:46:55.042180 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b6e0d5f8-f964-4149-8778-6fc346de5e2b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:55.043590 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b6e0d5f8-f964-4149-8778-6fc346de5e2b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:55.051562 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6e0d5f8-f964-4149-8778-6fc346de5e2b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:55.052117 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6e0d5f8-f964-4149-8778-6fc346de5e2b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:55.053051 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6e0d5f8-f964-4149-8778-6fc346de5e2b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:55.053563 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b6e0d5f8-f964-4149-8778-6fc346de5e2b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:55.199956 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b6e0d5f8-f964-4149-8778-6fc346de5e2b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:55.208966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b6e0d5f8-f964-4149-8778-6fc346de5e2b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1707 microversion: 2.1 time: 0.171196 Jul 20 11:46:55.209931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 542/1096] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:55 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1707 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:55.340448 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-abc35e5b-3630-472f-9d2e-a3b1190291f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:55.341134 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-abc35e5b-3630-472f-9d2e-a3b1190291f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:55.347751 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abc35e5b-3630-472f-9d2e-a3b1190291f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:55.356284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abc35e5b-3630-472f-9d2e-a3b1190291f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:55.356284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abc35e5b-3630-472f-9d2e-a3b1190291f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:55.356284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-abc35e5b-3630-472f-9d2e-a3b1190291f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:55.477404 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-abc35e5b-3630-472f-9d2e-a3b1190291f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:55.485472 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-abc35e5b-3630-472f-9d2e-a3b1190291f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:55.486985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-abc35e5b-3630-472f-9d2e-a3b1190291f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:55.488154 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-abc35e5b-3630-472f-9d2e-a3b1190291f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1740 microversion: 2.20 time: 0.152074 Jul 20 11:46:55.488717 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 555/1097] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:55 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:46:56.226524 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-893cf429-4f61-4f82-a8f5-06982c879d96 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:56.227129 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-893cf429-4f61-4f82-a8f5-06982c879d96 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:56.233614 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-893cf429-4f61-4f82-a8f5-06982c879d96 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:56.234053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-893cf429-4f61-4f82-a8f5-06982c879d96 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:56.234808 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-893cf429-4f61-4f82-a8f5-06982c879d96 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:56.235234 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-893cf429-4f61-4f82-a8f5-06982c879d96 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:56.363495 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-893cf429-4f61-4f82-a8f5-06982c879d96 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:56.371797 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-893cf429-4f61-4f82-a8f5-06982c879d96 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1711 microversion: 2.1 time: 0.149153 Jul 20 11:46:56.372353 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 543/1098] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:46:56 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1711 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:46:56.507192 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-51369372-9473-44fa-a41d-d7384d66ed8f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:56.507789 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-51369372-9473-44fa-a41d-d7384d66ed8f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:56.514298 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51369372-9473-44fa-a41d-d7384d66ed8f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:56.519403 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51369372-9473-44fa-a41d-d7384d66ed8f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:56.519403 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51369372-9473-44fa-a41d-d7384d66ed8f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:56.519403 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-51369372-9473-44fa-a41d-d7384d66ed8f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:56.650522 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-51369372-9473-44fa-a41d-d7384d66ed8f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:56.658799 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-51369372-9473-44fa-a41d-d7384d66ed8f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:56.660311 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-51369372-9473-44fa-a41d-d7384d66ed8f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:56.661547 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-51369372-9473-44fa-a41d-d7384d66ed8f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1740 microversion: 2.20 time: 0.158323 Jul 20 11:46:56.662105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 556/1099] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:56 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:46:57.680300 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a536b13-092d-4be2-a6ab-22db07f564c9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:57.681485 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a536b13-092d-4be2-a6ab-22db07f564c9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:57.688123 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a536b13-092d-4be2-a6ab-22db07f564c9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:57.688552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a536b13-092d-4be2-a6ab-22db07f564c9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:57.689347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a536b13-092d-4be2-a6ab-22db07f564c9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:57.689785 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a536b13-092d-4be2-a6ab-22db07f564c9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:57.816257 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a536b13-092d-4be2-a6ab-22db07f564c9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:57.824742 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a536b13-092d-4be2-a6ab-22db07f564c9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:57.826272 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a536b13-092d-4be2-a6ab-22db07f564c9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:57.827411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a536b13-092d-4be2-a6ab-22db07f564c9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1722 microversion: 2.20 time: 0.151057 Jul 20 11:46:57.827967 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 544/1100] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:57 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:46:58.853461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-498831fa-8f3a-4810-a058-45a795e444df tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:46:58.854174 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-498831fa-8f3a-4810-a058-45a795e444df tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:46:58.860913 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-498831fa-8f3a-4810-a058-45a795e444df tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:58.861360 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-498831fa-8f3a-4810-a058-45a795e444df tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:58.862220 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-498831fa-8f3a-4810-a058-45a795e444df tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:46:58.862650 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-498831fa-8f3a-4810-a058-45a795e444df tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:46:58.997885 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-498831fa-8f3a-4810-a058-45a795e444df tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:59.005777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-498831fa-8f3a-4810-a058-45a795e444df tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:59.007284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-498831fa-8f3a-4810-a058-45a795e444df tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:46:59.008442 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-498831fa-8f3a-4810-a058-45a795e444df tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1722 microversion: 2.20 time: 0.159368 Jul 20 11:46:59.009760 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 557/1101] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:46:58 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:00.027570 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7cb846f4-ad4b-40a8-b57a-58dcc11a4431 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:00.028180 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7cb846f4-ad4b-40a8-b57a-58dcc11a4431 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:00.035025 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cb846f4-ad4b-40a8-b57a-58dcc11a4431 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:00.035478 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cb846f4-ad4b-40a8-b57a-58dcc11a4431 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:00.036241 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cb846f4-ad4b-40a8-b57a-58dcc11a4431 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:00.036677 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7cb846f4-ad4b-40a8-b57a-58dcc11a4431 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:00.172831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7cb846f4-ad4b-40a8-b57a-58dcc11a4431 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:00.183399 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7cb846f4-ad4b-40a8-b57a-58dcc11a4431 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:00.184949 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7cb846f4-ad4b-40a8-b57a-58dcc11a4431 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:00.186115 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7cb846f4-ad4b-40a8-b57a-58dcc11a4431 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1665 microversion: 2.20 time: 0.163079 Jul 20 11:47:00.186681 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 545/1102] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:00 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1665 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:00.204251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4342d73d-177b-4944-a0fb-82ce6a9f014d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f2dccfd-8ad5-40e6-a6bd-e7fc1195bfc6"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:47:00.205465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4342d73d-177b-4944-a0fb-82ce6a9f014d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:00.212252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4342d73d-177b-4944-a0fb-82ce6a9f014d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:00.213249 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4342d73d-177b-4944-a0fb-82ce6a9f014d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:00.214025 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4342d73d-177b-4944-a0fb-82ce6a9f014d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:00.214465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4342d73d-177b-4944-a0fb-82ce6a9f014d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:00.298724 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:47:00.733793 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-e18daa86-1d7a-4dcd-a192-0e74e4826f2c req-5e0ef87f-7a4a-439d-af44-1626f6a8f3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38ac977-daa5-4751-a9e8-12c27706032e", "name": "network-vif-unplugged", "status": "completed", "tag": "98fc8e3d-93c5-45a0-9829-77da42ba8ac3"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:47:00.742162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-e18daa86-1d7a-4dcd-a192-0e74e4826f2c req-5e0ef87f-7a4a-439d-af44-1626f6a8f3b5 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:00.742606 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-e18daa86-1d7a-4dcd-a192-0e74e4826f2c req-5e0ef87f-7a4a-439d-af44-1626f6a8f3b5 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:00.757555 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.compute.server_external_events [req-e18daa86-1d7a-4dcd-a192-0e74e4826f2c req-5e0ef87f-7a4a-439d-af44-1626f6a8f3b5 service nova] Unable to find a host for instance e38ac977-daa5-4751-a9e8-12c27706032e. Dropping event network-vif-unplugged {{(pid=124830) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 11:47:00.758425 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-e18daa86-1d7a-4dcd-a192-0e74e4826f2c req-5e0ef87f-7a4a-439d-af44-1626f6a8f3b5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028726 Jul 20 11:47:00.759665 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 546/1103] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 20 11:47:01.142687 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4342d73d-177b-4944-a0fb-82ce6a9f014d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "POST /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.942347 Jul 20 11:47:01.143295 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 558/1104] 10.222.0.43 () {62 vars in 1363 bytes} [Wed Jul 20 11:47:00 2022] POST /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/os-volume_attachments => generated 188 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:47:01.262895 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6aff81b1-0fac-4edb-b949-178971a861ce tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:01.263406 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6aff81b1-0fac-4edb-b949-178971a861ce tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:01.269778 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6aff81b1-0fac-4edb-b949-178971a861ce tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:01.270221 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6aff81b1-0fac-4edb-b949-178971a861ce tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:01.270978 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6aff81b1-0fac-4edb-b949-178971a861ce tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:01.271406 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6aff81b1-0fac-4edb-b949-178971a861ce tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:01.779489 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:47:01.858528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6aff81b1-0fac-4edb-b949-178971a861ce tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/os-volume_attachments/2f2dccfd-8ad5-40e6-a6bd-e7fc1195bfc6" status: 202 len: 0 microversion: 2.20 time: 0.599501 Jul 20 11:47:01.859136 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 547/1105] 10.222.0.43 () {60 vars in 1456 bytes} [Wed Jul 20 11:47:01 2022] DELETE /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/os-volume_attachments/2f2dccfd-8ad5-40e6-a6bd-e7fc1195bfc6 => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:47:01.915360 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e0b08c5d-8e16-4787-a357-9054ce33b9da tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:47:01.915928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e0b08c5d-8e16-4787-a357-9054ce33b9da tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:01.923101 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0b08c5d-8e16-4787-a357-9054ce33b9da tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:01.923543 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0b08c5d-8e16-4787-a357-9054ce33b9da tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:01.924300 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0b08c5d-8e16-4787-a357-9054ce33b9da tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:01.924734 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e0b08c5d-8e16-4787-a357-9054ce33b9da tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:02.110993 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e0b08c5d-8e16-4787-a357-9054ce33b9da tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "POST /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/action" status: 202 len: 0 microversion: 2.20 time: 0.199424 Jul 20 11:47:02.111522 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 559/1106] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jul 20 11:47:01 2022] POST /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:47:02.120391 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e11d74f7-6872-4e11-973b-a0651a928358 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:02.121026 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e11d74f7-6872-4e11-973b-a0651a928358 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:02.130492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e11d74f7-6872-4e11-973b-a0651a928358 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:02.130939 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e11d74f7-6872-4e11-973b-a0651a928358 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:02.131723 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e11d74f7-6872-4e11-973b-a0651a928358 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:02.132161 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e11d74f7-6872-4e11-973b-a0651a928358 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:02.265530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e11d74f7-6872-4e11-973b-a0651a928358 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:02.274311 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e11d74f7-6872-4e11-973b-a0651a928358 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:02.276360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e11d74f7-6872-4e11-973b-a0651a928358 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:02.277060 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e11d74f7-6872-4e11-973b-a0651a928358 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1673 microversion: 2.20 time: 0.161405 Jul 20 11:47:02.277614 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 548/1107] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:02 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:03.295513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-53c61edf-5feb-49e9-b5f7-8569f4cc6feb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:03.296129 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-53c61edf-5feb-49e9-b5f7-8569f4cc6feb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:03.302054 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53c61edf-5feb-49e9-b5f7-8569f4cc6feb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:03.302499 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53c61edf-5feb-49e9-b5f7-8569f4cc6feb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:03.303303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53c61edf-5feb-49e9-b5f7-8569f4cc6feb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:03.304335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-53c61edf-5feb-49e9-b5f7-8569f4cc6feb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:03.434839 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-53c61edf-5feb-49e9-b5f7-8569f4cc6feb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:03.444221 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-53c61edf-5feb-49e9-b5f7-8569f4cc6feb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:03.445756 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-53c61edf-5feb-49e9-b5f7-8569f4cc6feb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:03.447419 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-53c61edf-5feb-49e9-b5f7-8569f4cc6feb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.156399 Jul 20 11:47:03.447979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 560/1108] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:03 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:04.466583 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-19989c9e-40da-4df8-bbaf-e5998f600d22 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:04.467194 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-19989c9e-40da-4df8-bbaf-e5998f600d22 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:04.473712 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19989c9e-40da-4df8-bbaf-e5998f600d22 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:04.474162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19989c9e-40da-4df8-bbaf-e5998f600d22 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:04.474927 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19989c9e-40da-4df8-bbaf-e5998f600d22 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:04.475359 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-19989c9e-40da-4df8-bbaf-e5998f600d22 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:04.618396 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19989c9e-40da-4df8-bbaf-e5998f600d22 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:04.626810 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19989c9e-40da-4df8-bbaf-e5998f600d22 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:04.628306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-19989c9e-40da-4df8-bbaf-e5998f600d22 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:04.629480 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-19989c9e-40da-4df8-bbaf-e5998f600d22 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.167326 Jul 20 11:47:04.630038 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 549/1109] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:04 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:05.647641 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3d2efb18-8332-45de-90f6-27d482e32257 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:05.648240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3d2efb18-8332-45de-90f6-27d482e32257 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:05.655180 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d2efb18-8332-45de-90f6-27d482e32257 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:05.655629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d2efb18-8332-45de-90f6-27d482e32257 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:05.656392 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d2efb18-8332-45de-90f6-27d482e32257 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:05.656895 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3d2efb18-8332-45de-90f6-27d482e32257 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:05.796220 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d2efb18-8332-45de-90f6-27d482e32257 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:05.819975 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d2efb18-8332-45de-90f6-27d482e32257 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:05.822220 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3d2efb18-8332-45de-90f6-27d482e32257 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:05.823414 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3d2efb18-8332-45de-90f6-27d482e32257 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.179830 Jul 20 11:47:05.823984 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 561/1110] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:05 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:06.843242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a19b8f3c-4026-4619-9bb1-188956e49a84 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:06.844673 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a19b8f3c-4026-4619-9bb1-188956e49a84 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:06.857049 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a19b8f3c-4026-4619-9bb1-188956e49a84 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:06.857581 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a19b8f3c-4026-4619-9bb1-188956e49a84 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:06.858423 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a19b8f3c-4026-4619-9bb1-188956e49a84 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:06.858860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a19b8f3c-4026-4619-9bb1-188956e49a84 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:07.007187 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a19b8f3c-4026-4619-9bb1-188956e49a84 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:07.015051 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a19b8f3c-4026-4619-9bb1-188956e49a84 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:07.016529 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a19b8f3c-4026-4619-9bb1-188956e49a84 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:07.017703 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a19b8f3c-4026-4619-9bb1-188956e49a84 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.179605 Jul 20 11:47:07.018266 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 550/1111] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:06 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:08.037782 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-238c3446-05e5-4c06-9727-22de95cf0bd6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:08.040831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-238c3446-05e5-4c06-9727-22de95cf0bd6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:08.048744 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-238c3446-05e5-4c06-9727-22de95cf0bd6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:08.049473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-238c3446-05e5-4c06-9727-22de95cf0bd6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:08.050299 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-238c3446-05e5-4c06-9727-22de95cf0bd6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:08.050748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-238c3446-05e5-4c06-9727-22de95cf0bd6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:08.199852 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-238c3446-05e5-4c06-9727-22de95cf0bd6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:08.207849 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-238c3446-05e5-4c06-9727-22de95cf0bd6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:08.209396 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-238c3446-05e5-4c06-9727-22de95cf0bd6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:08.210570 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-238c3446-05e5-4c06-9727-22de95cf0bd6 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.177277 Jul 20 11:47:08.211135 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 562/1112] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:08 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:47:09.228876 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3adedf18-f1f0-4b48-b156-b0c8f99bf2d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:09.229486 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3adedf18-f1f0-4b48-b156-b0c8f99bf2d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:09.235969 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3adedf18-f1f0-4b48-b156-b0c8f99bf2d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:09.236404 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3adedf18-f1f0-4b48-b156-b0c8f99bf2d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:09.237185 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3adedf18-f1f0-4b48-b156-b0c8f99bf2d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:09.237614 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3adedf18-f1f0-4b48-b156-b0c8f99bf2d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:09.369634 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3adedf18-f1f0-4b48-b156-b0c8f99bf2d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:09.377478 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3adedf18-f1f0-4b48-b156-b0c8f99bf2d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:09.378973 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3adedf18-f1f0-4b48-b156-b0c8f99bf2d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:09.380151 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3adedf18-f1f0-4b48-b156-b0c8f99bf2d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.155289 Jul 20 11:47:09.380714 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 551/1113] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:09 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:10.399278 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee18e9ba-4b49-43d7-9d76-7f73857adead tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:10.400468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ee18e9ba-4b49-43d7-9d76-7f73857adead tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:10.407018 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee18e9ba-4b49-43d7-9d76-7f73857adead tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:10.407475 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee18e9ba-4b49-43d7-9d76-7f73857adead tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:10.408229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee18e9ba-4b49-43d7-9d76-7f73857adead tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:10.408661 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ee18e9ba-4b49-43d7-9d76-7f73857adead tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:10.560494 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee18e9ba-4b49-43d7-9d76-7f73857adead tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:10.568943 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee18e9ba-4b49-43d7-9d76-7f73857adead tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:10.570445 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ee18e9ba-4b49-43d7-9d76-7f73857adead tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:10.571588 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee18e9ba-4b49-43d7-9d76-7f73857adead tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.176495 Jul 20 11:47:10.572137 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 563/1114] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:10 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:11.589990 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6c1bdf8a-0386-4dcc-bded-71490e583a86 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:11.590578 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6c1bdf8a-0386-4dcc-bded-71490e583a86 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:11.597146 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c1bdf8a-0386-4dcc-bded-71490e583a86 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:11.597593 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c1bdf8a-0386-4dcc-bded-71490e583a86 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:11.598360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c1bdf8a-0386-4dcc-bded-71490e583a86 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:11.598788 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6c1bdf8a-0386-4dcc-bded-71490e583a86 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:11.729135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6c1bdf8a-0386-4dcc-bded-71490e583a86 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:11.736904 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6c1bdf8a-0386-4dcc-bded-71490e583a86 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:11.738409 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6c1bdf8a-0386-4dcc-bded-71490e583a86 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:11.739558 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6c1bdf8a-0386-4dcc-bded-71490e583a86 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.153513 Jul 20 11:47:11.740117 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 552/1115] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:11 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:12.758453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4e90ec70-d803-46e8-a7c4-14f37dbb671f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:12.759863 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4e90ec70-d803-46e8-a7c4-14f37dbb671f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:12.766573 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e90ec70-d803-46e8-a7c4-14f37dbb671f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:12.770530 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e90ec70-d803-46e8-a7c4-14f37dbb671f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:12.770530 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e90ec70-d803-46e8-a7c4-14f37dbb671f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:12.770530 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4e90ec70-d803-46e8-a7c4-14f37dbb671f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:12.910920 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4e90ec70-d803-46e8-a7c4-14f37dbb671f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:12.919726 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4e90ec70-d803-46e8-a7c4-14f37dbb671f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:12.921308 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4e90ec70-d803-46e8-a7c4-14f37dbb671f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:12.922493 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4e90ec70-d803-46e8-a7c4-14f37dbb671f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.168032 Jul 20 11:47:12.923057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 564/1116] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:12 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:13.941240 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8dfef1ef-1aba-4527-9ca3-480128a79cf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:13.941830 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8dfef1ef-1aba-4527-9ca3-480128a79cf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:13.948273 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8dfef1ef-1aba-4527-9ca3-480128a79cf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:13.948715 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8dfef1ef-1aba-4527-9ca3-480128a79cf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:13.949510 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8dfef1ef-1aba-4527-9ca3-480128a79cf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:13.949934 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8dfef1ef-1aba-4527-9ca3-480128a79cf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:14.095752 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8dfef1ef-1aba-4527-9ca3-480128a79cf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:14.104341 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8dfef1ef-1aba-4527-9ca3-480128a79cf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:14.105894 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8dfef1ef-1aba-4527-9ca3-480128a79cf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:14.107132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8dfef1ef-1aba-4527-9ca3-480128a79cf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.169756 Jul 20 11:47:14.107894 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 553/1117] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:13 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:15.126492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bccf2977-4bb1-4109-87e2-2d3504514fe1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:15.150724 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bccf2977-4bb1-4109-87e2-2d3504514fe1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:15.150724 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bccf2977-4bb1-4109-87e2-2d3504514fe1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:15.150724 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bccf2977-4bb1-4109-87e2-2d3504514fe1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:15.150724 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bccf2977-4bb1-4109-87e2-2d3504514fe1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:15.151159 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bccf2977-4bb1-4109-87e2-2d3504514fe1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:15.293623 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bccf2977-4bb1-4109-87e2-2d3504514fe1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:15.301742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bccf2977-4bb1-4109-87e2-2d3504514fe1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:15.303287 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bccf2977-4bb1-4109-87e2-2d3504514fe1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:15.304479 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bccf2977-4bb1-4109-87e2-2d3504514fe1 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.182948 Jul 20 11:47:15.309342 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 565/1118] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:15 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:16.323117 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5f83e506-360b-4574-b08b-07b70071ff70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:16.323710 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5f83e506-360b-4574-b08b-07b70071ff70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:16.326064 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=46 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:47:16.330757 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f83e506-360b-4574-b08b-07b70071ff70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:16.331201 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f83e506-360b-4574-b08b-07b70071ff70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:16.331956 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f83e506-360b-4574-b08b-07b70071ff70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:16.332386 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5f83e506-360b-4574-b08b-07b70071ff70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:16.475040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f83e506-360b-4574-b08b-07b70071ff70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:16.482740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f83e506-360b-4574-b08b-07b70071ff70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:16.484357 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5f83e506-360b-4574-b08b-07b70071ff70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:16.485571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5f83e506-360b-4574-b08b-07b70071ff70 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.166394 Jul 20 11:47:16.486638 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 554/1119] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:16 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:17.504043 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2711ee83-c8c9-4e4f-806b-c6bddbf23139 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:17.504682 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2711ee83-c8c9-4e4f-806b-c6bddbf23139 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:17.506996 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=44 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:47:17.511698 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2711ee83-c8c9-4e4f-806b-c6bddbf23139 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:17.512149 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2711ee83-c8c9-4e4f-806b-c6bddbf23139 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:17.512948 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2711ee83-c8c9-4e4f-806b-c6bddbf23139 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:17.513452 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2711ee83-c8c9-4e4f-806b-c6bddbf23139 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:17.641421 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2711ee83-c8c9-4e4f-806b-c6bddbf23139 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:17.649258 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2711ee83-c8c9-4e4f-806b-c6bddbf23139 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:17.650762 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2711ee83-c8c9-4e4f-806b-c6bddbf23139 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:17.651915 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2711ee83-c8c9-4e4f-806b-c6bddbf23139 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.151792 Jul 20 11:47:17.652479 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 566/1120] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:17 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:18.670483 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bbb40a3d-9788-497e-9428-e94eb9f0ef06 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:18.671074 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bbb40a3d-9788-497e-9428-e94eb9f0ef06 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:18.677557 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbb40a3d-9788-497e-9428-e94eb9f0ef06 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:18.678000 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbb40a3d-9788-497e-9428-e94eb9f0ef06 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:18.678760 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbb40a3d-9788-497e-9428-e94eb9f0ef06 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:18.679189 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bbb40a3d-9788-497e-9428-e94eb9f0ef06 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:18.807050 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bbb40a3d-9788-497e-9428-e94eb9f0ef06 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:18.814913 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bbb40a3d-9788-497e-9428-e94eb9f0ef06 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:18.816419 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bbb40a3d-9788-497e-9428-e94eb9f0ef06 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:18.817602 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bbb40a3d-9788-497e-9428-e94eb9f0ef06 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.151042 Jul 20 11:47:18.818159 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 555/1121] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:18 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:19.836372 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-743422a5-be2e-4f3f-a848-900047fd835c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:19.837627 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-743422a5-be2e-4f3f-a848-900047fd835c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:19.844092 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-743422a5-be2e-4f3f-a848-900047fd835c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:19.844535 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-743422a5-be2e-4f3f-a848-900047fd835c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:19.845329 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-743422a5-be2e-4f3f-a848-900047fd835c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:19.845791 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-743422a5-be2e-4f3f-a848-900047fd835c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:19.976336 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-743422a5-be2e-4f3f-a848-900047fd835c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:19.984614 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-743422a5-be2e-4f3f-a848-900047fd835c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:19.986129 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-743422a5-be2e-4f3f-a848-900047fd835c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:19.987263 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-743422a5-be2e-4f3f-a848-900047fd835c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.154770 Jul 20 11:47:19.987817 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 567/1122] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:19 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:21.006075 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d94e8e2c-c518-415e-b6c2-7a68ad821528 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:21.006680 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d94e8e2c-c518-415e-b6c2-7a68ad821528 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:21.013292 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d94e8e2c-c518-415e-b6c2-7a68ad821528 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:21.013736 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d94e8e2c-c518-415e-b6c2-7a68ad821528 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:21.014496 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d94e8e2c-c518-415e-b6c2-7a68ad821528 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:21.014926 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d94e8e2c-c518-415e-b6c2-7a68ad821528 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:21.150278 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d94e8e2c-c518-415e-b6c2-7a68ad821528 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:21.158414 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d94e8e2c-c518-415e-b6c2-7a68ad821528 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:21.161588 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d94e8e2c-c518-415e-b6c2-7a68ad821528 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:21.161588 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d94e8e2c-c518-415e-b6c2-7a68ad821528 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.158922 Jul 20 11:47:21.161801 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 556/1123] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:21 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:47:22.179449 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-414c5b29-c03a-4204-a83f-377d6127f86a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:22.180056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-414c5b29-c03a-4204-a83f-377d6127f86a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:22.187161 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-414c5b29-c03a-4204-a83f-377d6127f86a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:22.187607 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-414c5b29-c03a-4204-a83f-377d6127f86a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:22.188371 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-414c5b29-c03a-4204-a83f-377d6127f86a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:22.188827 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-414c5b29-c03a-4204-a83f-377d6127f86a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:22.323272 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-414c5b29-c03a-4204-a83f-377d6127f86a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:22.334483 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-414c5b29-c03a-4204-a83f-377d6127f86a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:22.335985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-414c5b29-c03a-4204-a83f-377d6127f86a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:22.337787 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-414c5b29-c03a-4204-a83f-377d6127f86a tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.161633 Jul 20 11:47:22.338558 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 568/1124] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:22 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:23.356584 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2fcccaea-df9e-454d-845b-e40e0474b0f9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:23.357213 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2fcccaea-df9e-454d-845b-e40e0474b0f9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:23.363720 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fcccaea-df9e-454d-845b-e40e0474b0f9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:23.364160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fcccaea-df9e-454d-845b-e40e0474b0f9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:23.364949 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fcccaea-df9e-454d-845b-e40e0474b0f9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:23.365382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2fcccaea-df9e-454d-845b-e40e0474b0f9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:23.491603 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2fcccaea-df9e-454d-845b-e40e0474b0f9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:23.499545 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2fcccaea-df9e-454d-845b-e40e0474b0f9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:23.501087 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2fcccaea-df9e-454d-845b-e40e0474b0f9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:23.502244 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2fcccaea-df9e-454d-845b-e40e0474b0f9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.150589 Jul 20 11:47:23.502808 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 557/1125] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:23 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:24.520436 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9346509b-6cf5-4341-8448-9b6acf43cdf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:24.521078 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9346509b-6cf5-4341-8448-9b6acf43cdf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:24.527828 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9346509b-6cf5-4341-8448-9b6acf43cdf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:24.528279 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9346509b-6cf5-4341-8448-9b6acf43cdf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:24.529328 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9346509b-6cf5-4341-8448-9b6acf43cdf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:24.529768 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9346509b-6cf5-4341-8448-9b6acf43cdf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:24.663511 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9346509b-6cf5-4341-8448-9b6acf43cdf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:24.672171 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9346509b-6cf5-4341-8448-9b6acf43cdf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:24.673698 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9346509b-6cf5-4341-8448-9b6acf43cdf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:24.674855 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9346509b-6cf5-4341-8448-9b6acf43cdf5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.158283 Jul 20 11:47:24.675643 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 569/1126] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:24 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:25.693085 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-38540669-1209-4d16-933d-a3a2c5650b04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:25.693632 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-38540669-1209-4d16-933d-a3a2c5650b04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:25.700678 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38540669-1209-4d16-933d-a3a2c5650b04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:25.701161 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38540669-1209-4d16-933d-a3a2c5650b04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:25.701952 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38540669-1209-4d16-933d-a3a2c5650b04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:25.702387 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-38540669-1209-4d16-933d-a3a2c5650b04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:25.838081 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-38540669-1209-4d16-933d-a3a2c5650b04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:25.846100 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-38540669-1209-4d16-933d-a3a2c5650b04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:25.847608 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-38540669-1209-4d16-933d-a3a2c5650b04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:25.848799 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-38540669-1209-4d16-933d-a3a2c5650b04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.159782 Jul 20 11:47:25.849389 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 558/1127] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:25 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:26.867964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-487b1e46-5d07-4fa7-9cb2-6af693a42c04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:26.868731 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-487b1e46-5d07-4fa7-9cb2-6af693a42c04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:26.877479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487b1e46-5d07-4fa7-9cb2-6af693a42c04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:26.878152 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487b1e46-5d07-4fa7-9cb2-6af693a42c04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:26.878931 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487b1e46-5d07-4fa7-9cb2-6af693a42c04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:26.879359 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-487b1e46-5d07-4fa7-9cb2-6af693a42c04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:26.894233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-fafbe604-3660-4b11-9bb4-4b28f6537f7e req-a6d49214-3716-4a30-9c7b-7ec8e60b84ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38ac977-daa5-4751-a9e8-12c27706032e", "name": "network-vif-plugged", "status": "completed", "tag": "98fc8e3d-93c5-45a0-9829-77da42ba8ac3"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:47:26.905464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-fafbe604-3660-4b11-9bb4-4b28f6537f7e req-a6d49214-3716-4a30-9c7b-7ec8e60b84ad service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:26.905911 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-fafbe604-3660-4b11-9bb4-4b28f6537f7e req-a6d49214-3716-4a30-9c7b-7ec8e60b84ad service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:26.917609 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-fafbe604-3660-4b11-9bb4-4b28f6537f7e req-a6d49214-3716-4a30-9c7b-7ec8e60b84ad service nova] Creating event network-vif-plugged:98fc8e3d-93c5-45a0-9829-77da42ba8ac3 for instance e38ac977-daa5-4751-a9e8-12c27706032e on hv-cinder-82282 Jul 20 11:47:26.922750 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-fafbe604-3660-4b11-9bb4-4b28f6537f7e req-a6d49214-3716-4a30-9c7b-7ec8e60b84ad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159965 Jul 20 11:47:26.923473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 570/1128] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:47:27.012563 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-487b1e46-5d07-4fa7-9cb2-6af693a42c04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:27.020454 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-487b1e46-5d07-4fa7-9cb2-6af693a42c04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:27.021980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-487b1e46-5d07-4fa7-9cb2-6af693a42c04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:27.023121 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-487b1e46-5d07-4fa7-9cb2-6af693a42c04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.159712 Jul 20 11:47:27.023674 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 559/1129] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:26 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:47:28.043390 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9a51515f-3588-47bb-a513-a61a35406b64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:28.044076 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9a51515f-3588-47bb-a513-a61a35406b64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:28.050197 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a51515f-3588-47bb-a513-a61a35406b64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:28.050639 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a51515f-3588-47bb-a513-a61a35406b64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:28.051390 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a51515f-3588-47bb-a513-a61a35406b64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:28.051816 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9a51515f-3588-47bb-a513-a61a35406b64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:28.202326 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9a51515f-3588-47bb-a513-a61a35406b64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:28.210275 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9a51515f-3588-47bb-a513-a61a35406b64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:28.212437 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9a51515f-3588-47bb-a513-a61a35406b64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:28.213646 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9a51515f-3588-47bb-a513-a61a35406b64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.175612 Jul 20 11:47:28.214207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 571/1130] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:28 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:29.232272 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a71d54b8-ba9c-45e8-afff-aee292ab5902 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:29.232893 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a71d54b8-ba9c-45e8-afff-aee292ab5902 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:29.239268 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a71d54b8-ba9c-45e8-afff-aee292ab5902 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:29.239703 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a71d54b8-ba9c-45e8-afff-aee292ab5902 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:29.240459 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a71d54b8-ba9c-45e8-afff-aee292ab5902 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:29.240922 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a71d54b8-ba9c-45e8-afff-aee292ab5902 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:29.375291 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a71d54b8-ba9c-45e8-afff-aee292ab5902 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:29.383085 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a71d54b8-ba9c-45e8-afff-aee292ab5902 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:29.388478 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a71d54b8-ba9c-45e8-afff-aee292ab5902 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:29.388478 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a71d54b8-ba9c-45e8-afff-aee292ab5902 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1731 microversion: 2.20 time: 0.158054 Jul 20 11:47:29.388478 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 560/1131] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:29 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:30.404497 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-226fa1df-5a1c-430a-8e7c-99f5162748d5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:30.405128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-226fa1df-5a1c-430a-8e7c-99f5162748d5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:30.411973 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-226fa1df-5a1c-430a-8e7c-99f5162748d5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:30.412420 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-226fa1df-5a1c-430a-8e7c-99f5162748d5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:30.413208 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-226fa1df-5a1c-430a-8e7c-99f5162748d5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:30.413638 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-226fa1df-5a1c-430a-8e7c-99f5162748d5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:30.547462 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-226fa1df-5a1c-430a-8e7c-99f5162748d5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:30.550922 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:47:30.556415 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-226fa1df-5a1c-430a-8e7c-99f5162748d5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:30.557960 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-226fa1df-5a1c-430a-8e7c-99f5162748d5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:30.559133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-226fa1df-5a1c-430a-8e7c-99f5162748d5 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1718 microversion: 2.20 time: 0.158883 Jul 20 11:47:30.559685 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 572/1132] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:47:30 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:47:34.213898 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7d6a1ece-bc8a-4ffd-8701-3b5124c5982a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:34.214395 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7d6a1ece-bc8a-4ffd-8701-3b5124c5982a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:34.221261 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d6a1ece-bc8a-4ffd-8701-3b5124c5982a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:34.221702 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d6a1ece-bc8a-4ffd-8701-3b5124c5982a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:34.222461 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d6a1ece-bc8a-4ffd-8701-3b5124c5982a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:34.222892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7d6a1ece-bc8a-4ffd-8701-3b5124c5982a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:34.226449 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:47:34.245420 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7d6a1ece-bc8a-4ffd-8701-3b5124c5982a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/ips" status: 200 len: 148 microversion: 2.1 time: 0.036008 Jul 20 11:47:34.245982 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 561/1133] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 11:47:34 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:47:36.940490 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-567713fa-e196-4326-9ce0-3eb798772318 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "635c98aa-6130-4a4d-a77e-f4ba3f2a717a"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:47:36.941634 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-567713fa-e196-4326-9ce0-3eb798772318 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:36.949565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-567713fa-e196-4326-9ce0-3eb798772318 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:36.950013 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-567713fa-e196-4326-9ce0-3eb798772318 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:36.950772 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-567713fa-e196-4326-9ce0-3eb798772318 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:36.951206 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-567713fa-e196-4326-9ce0-3eb798772318 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:37.632770 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-567713fa-e196-4326-9ce0-3eb798772318 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "POST /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.696026 Jul 20 11:47:37.633409 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 573/1134] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:47:36 2022] POST /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/os-volume_attachments => generated 194 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:47:46.251569 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=15 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:47:46.255617 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4cee12e8-c0c8-4354-af75-9a58cf2ece42 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:46.256113 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4cee12e8-c0c8-4354-af75-9a58cf2ece42 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:46.262878 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cee12e8-c0c8-4354-af75-9a58cf2ece42 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:46.289640 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cee12e8-c0c8-4354-af75-9a58cf2ece42 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:46.289640 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cee12e8-c0c8-4354-af75-9a58cf2ece42 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:46.289640 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4cee12e8-c0c8-4354-af75-9a58cf2ece42 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:46.348513 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-4cee12e8-c0c8-4354-af75-9a58cf2ece42 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lazy-loading 'services' on Instance uuid def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:47:46.537311 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4cee12e8-c0c8-4354-af75-9a58cf2ece42 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/os-volume_attachments/635c98aa-6130-4a4d-a77e-f4ba3f2a717a" status: 202 len: 0 microversion: 2.1 time: 0.286838 Jul 20 11:47:46.537857 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 562/1135] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 11:47:46 2022] DELETE /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/os-volume_attachments/635c98aa-6130-4a4d-a77e-f4ba3f2a717a => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:47:46.548577 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-c5798e1a-da57-49e6-b13b-0fa15bd32e3e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:46.549655 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-c5798e1a-da57-49e6-b13b-0fa15bd32e3e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:46.555778 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5798e1a-da57-49e6-b13b-0fa15bd32e3e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:46.556220 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5798e1a-da57-49e6-b13b-0fa15bd32e3e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:46.557013 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5798e1a-da57-49e6-b13b-0fa15bd32e3e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:46.557442 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-c5798e1a-da57-49e6-b13b-0fa15bd32e3e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:46.585955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-c5798e1a-da57-49e6-b13b-0fa15bd32e3e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042307 Jul 20 11:47:46.586518 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 574/1136] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:47:46 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:47:47.598212 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f19fa22f-1171-449f-a452-185101e197a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:47.599344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f19fa22f-1171-449f-a452-185101e197a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:47.606826 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f19fa22f-1171-449f-a452-185101e197a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:47.607191 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f19fa22f-1171-449f-a452-185101e197a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:47.607950 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f19fa22f-1171-449f-a452-185101e197a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:47.608377 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f19fa22f-1171-449f-a452-185101e197a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:47.637659 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f19fa22f-1171-449f-a452-185101e197a9 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043683 Jul 20 11:47:47.638212 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 563/1137] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:47:47 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:47:48.746056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-99deb68f-985e-4065-9bc2-26c9a04136cd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:48.747016 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-99deb68f-985e-4065-9bc2-26c9a04136cd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:48.748945 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=18 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:47:48.753637 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99deb68f-985e-4065-9bc2-26c9a04136cd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:48.759209 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99deb68f-985e-4065-9bc2-26c9a04136cd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:48.759209 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99deb68f-985e-4065-9bc2-26c9a04136cd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:48.759209 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99deb68f-985e-4065-9bc2-26c9a04136cd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:48.783753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-99deb68f-985e-4065-9bc2-26c9a04136cd tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.139457 Jul 20 11:47:48.784297 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 575/1138] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:47:48 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:47:48.843810 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e8ffbedf-4b5e-4b4e-a0c9-5f8ef3255be0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:48.843810 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e8ffbedf-4b5e-4b4e-a0c9-5f8ef3255be0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:48.850205 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8ffbedf-4b5e-4b4e-a0c9-5f8ef3255be0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:48.852631 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8ffbedf-4b5e-4b4e-a0c9-5f8ef3255be0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:48.852631 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8ffbedf-4b5e-4b4e-a0c9-5f8ef3255be0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:48.852631 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e8ffbedf-4b5e-4b4e-a0c9-5f8ef3255be0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:48.878518 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e8ffbedf-4b5e-4b4e-a0c9-5f8ef3255be0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:47:49.137507 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e8ffbedf-4b5e-4b4e-a0c9-5f8ef3255be0 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 204 len: 0 microversion: 2.1 time: 0.297836 Jul 20 11:47:49.138101 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 564/1139] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:47:48 2022] DELETE /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:47:49.146223 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0942c2e0-5619-4b9f-a43f-fcd79a0c3332 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:49.147015 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0942c2e0-5619-4b9f-a43f-fcd79a0c3332 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:49.153255 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0942c2e0-5619-4b9f-a43f-fcd79a0c3332 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:49.153702 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0942c2e0-5619-4b9f-a43f-fcd79a0c3332 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:49.154463 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0942c2e0-5619-4b9f-a43f-fcd79a0c3332 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:49.155157 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0942c2e0-5619-4b9f-a43f-fcd79a0c3332 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:49.284634 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0942c2e0-5619-4b9f-a43f-fcd79a0c3332 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:49.292671 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0942c2e0-5619-4b9f-a43f-fcd79a0c3332 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1681 microversion: 2.1 time: 0.150335 Jul 20 11:47:49.293285 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 576/1140] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:47:49 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:47:50.311005 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2ced7c8a-bef0-4b1b-b865-98468860ec7a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:50.311704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2ced7c8a-bef0-4b1b-b865-98468860ec7a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:50.318144 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ced7c8a-bef0-4b1b-b865-98468860ec7a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:50.318592 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ced7c8a-bef0-4b1b-b865-98468860ec7a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:50.319350 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ced7c8a-bef0-4b1b-b865-98468860ec7a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:50.319782 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2ced7c8a-bef0-4b1b-b865-98468860ec7a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:50.448739 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2ced7c8a-bef0-4b1b-b865-98468860ec7a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:50.456237 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2ced7c8a-bef0-4b1b-b865-98468860ec7a tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1681 microversion: 2.1 time: 0.149482 Jul 20 11:47:50.456843 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 565/1141] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:47:50 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:47:51.473464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-90f4c99b-f470-43fa-81f7-e9269b24955e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:51.474079 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-90f4c99b-f470-43fa-81f7-e9269b24955e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:51.480459 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90f4c99b-f470-43fa-81f7-e9269b24955e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:51.480948 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90f4c99b-f470-43fa-81f7-e9269b24955e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:51.481723 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90f4c99b-f470-43fa-81f7-e9269b24955e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:51.482155 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-90f4c99b-f470-43fa-81f7-e9269b24955e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:51.613713 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-90f4c99b-f470-43fa-81f7-e9269b24955e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:51.621875 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-90f4c99b-f470-43fa-81f7-e9269b24955e tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1681 microversion: 2.1 time: 0.152225 Jul 20 11:47:51.622530 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 577/1142] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:47:51 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:47:52.507703 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-acd7884e-7f33-4694-9886-ee8ea444133d req-6104be20-1587-4952-8a06-eba43931b365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418", "name": "network-vif-deleted", "tag": "e8a2e484-b12d-4057-9d2f-36ca9d81ce4d"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:47:52.517158 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-acd7884e-7f33-4694-9886-ee8ea444133d req-6104be20-1587-4952-8a06-eba43931b365 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:52.517599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-acd7884e-7f33-4694-9886-ee8ea444133d req-6104be20-1587-4952-8a06-eba43931b365 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:52.529175 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-acd7884e-7f33-4694-9886-ee8ea444133d req-6104be20-1587-4952-8a06-eba43931b365 service nova] Creating event network-vif-deleted:e8a2e484-b12d-4057-9d2f-36ca9d81ce4d for instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 on hv-cinder-82282 Jul 20 11:47:52.535970 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-acd7884e-7f33-4694-9886-ee8ea444133d req-6104be20-1587-4952-8a06-eba43931b365 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030200 Jul 20 11:47:52.535970 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 566/1143] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:47:52.639119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ea634d91-e37a-4482-bfc1-884a9b4bf796 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:52.639738 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ea634d91-e37a-4482-bfc1-884a9b4bf796 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:52.646403 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea634d91-e37a-4482-bfc1-884a9b4bf796 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:52.646858 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea634d91-e37a-4482-bfc1-884a9b4bf796 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:52.647687 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea634d91-e37a-4482-bfc1-884a9b4bf796 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:52.648127 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ea634d91-e37a-4482-bfc1-884a9b4bf796 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:52.713217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ea634d91-e37a-4482-bfc1-884a9b4bf796 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c7d577e64f48cab8c331ff192be0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fa73c956fe44a59272f727320743e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:47:52.720955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ea634d91-e37a-4482-bfc1-884a9b4bf796 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 200 len: 1327 microversion: 2.1 time: 0.085735 Jul 20 11:47:52.721546 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 578/1144] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:47:52 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 1327 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:47:53.738771 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-beb86620-1dcb-4473-bdef-187e8f01e8ee tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:53.739468 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-beb86620-1dcb-4473-bdef-187e8f01e8ee tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:53.746336 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-beb86620-1dcb-4473-bdef-187e8f01e8ee tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:53.746781 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-beb86620-1dcb-4473-bdef-187e8f01e8ee tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:53.747542 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-beb86620-1dcb-4473-bdef-187e8f01e8ee tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:53.747978 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-beb86620-1dcb-4473-bdef-187e8f01e8ee tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:53.760713 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-beb86620-1dcb-4473-bdef-187e8f01e8ee tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-beb86620-1dcb-4473-bdef-187e8f01e8ee tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 HTTP/1.1 Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:47:53.762306 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:47:53.764099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:47:53.764099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:53.764099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:53.764099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:53.764099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:53.764099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:47:53.764099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:47:53.764099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:47:53.764099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:53.764099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:47:53.764099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:53.764099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418'} Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:47:53.765217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:53.766890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:53.768416 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-beb86620-1dcb-4473-bdef-187e8f01e8ee tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 404 to user: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:47:53.768416 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-beb86620-1dcb-4473-bdef-187e8f01e8ee tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 404 len: 111 microversion: 2.1 time: 0.029561 Jul 20 11:47:53.768416 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 567/1145] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:47:53 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:47:53.772500 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-94e4346e-3a20-42b5-9b01-29aed41a602b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '.version_select at 0x7f44dae31940>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:53.846654 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-94e4346e-3a20-42b5-9b01-29aed41a602b tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268452392" status: 202 len: 0 microversion: 2.1 time: 0.077933 Jul 20 11:47:53.847257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 579/1146] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jul 20 11:47:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268452392 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:47:54.575096 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:47:54.575292 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Wed Jul 20 11:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:47:55.803093 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0ecc2f2f-7216-4709-900e-7d30aded3e95 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:55.803660 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0ecc2f2f-7216-4709-900e-7d30aded3e95 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:55.811345 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ecc2f2f-7216-4709-900e-7d30aded3e95 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:55.811797 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ecc2f2f-7216-4709-900e-7d30aded3e95 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:55.819315 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ecc2f2f-7216-4709-900e-7d30aded3e95 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:55.819827 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0ecc2f2f-7216-4709-900e-7d30aded3e95 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:55.835093 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-0ecc2f2f-7216-4709-900e-7d30aded3e95 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0ecc2f2f-7216-4709-900e-7d30aded3e95 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 HTTP/1.1 Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:47:55.836624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:47:55.838309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:47:55.838309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:55.838309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:55.838309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:55.838309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:55.838309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:47:55.838309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:47:55.838309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:47:55.838309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:55.838309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:47:55.838309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:55.838309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418'} Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:47:55.839231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:55.840497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:55.842146 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0ecc2f2f-7216-4709-900e-7d30aded3e95 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 404 to user: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:47:55.842146 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0ecc2f2f-7216-4709-900e-7d30aded3e95 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 404 len: 111 microversion: 2.1 time: 0.038755 Jul 20 11:47:55.842146 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 568/1147] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:47:55 2022] DELETE /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:47:55.846845 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-13edc2ae-2ead-4ebd-ac9e-dc3480d71b98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:55.847487 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-13edc2ae-2ead-4ebd-ac9e-dc3480d71b98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:55.855124 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13edc2ae-2ead-4ebd-ac9e-dc3480d71b98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:55.855579 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13edc2ae-2ead-4ebd-ac9e-dc3480d71b98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:55.856348 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13edc2ae-2ead-4ebd-ac9e-dc3480d71b98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:55.856842 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-13edc2ae-2ead-4ebd-ac9e-dc3480d71b98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:55.870383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-13edc2ae-2ead-4ebd-ac9e-dc3480d71b98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-13edc2ae-2ead-4ebd-ac9e-dc3480d71b98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 HTTP/1.1 Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:47:55.872055 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:47:55.873781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:47:55.873781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:55.873781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:55.873781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:55.873781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:55.873781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:47:55.873781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:47:55.873781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:47:55.873781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:55.873781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:47:55.873781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:55.873781 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418'} Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:47:55.874621 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. Jul 20 11:47:55.876020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:55.877383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-13edc2ae-2ead-4ebd-ac9e-dc3480d71b98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 404 to user: Instance def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:47:55.877383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-13edc2ae-2ead-4ebd-ac9e-dc3480d71b98 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418" status: 404 len: 111 microversion: 2.1 time: 0.030560 Jul 20 11:47:55.877383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 580/1148] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:47:55 2022] GET /compute/v2.1/servers/def3fac1-f38d-4a5f-9cc4-7f6ce3cd4418 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:47:57.132746 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d280ceb2-8c51-41c8-8f04-f7e10ad1713d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:57.133321 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d280ceb2-8c51-41c8-8f04-f7e10ad1713d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:57.139857 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d280ceb2-8c51-41c8-8f04-f7e10ad1713d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:57.140317 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d280ceb2-8c51-41c8-8f04-f7e10ad1713d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:57.141118 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d280ceb2-8c51-41c8-8f04-f7e10ad1713d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:57.141657 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d280ceb2-8c51-41c8-8f04-f7e10ad1713d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:57.155515 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-d280ceb2-8c51-41c8-8f04-f7e10ad1713d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d280ceb2-8c51-41c8-8f04-f7e10ad1713d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c HTTP/1.1 Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:47:57.158512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:47:57.159988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:47:57.159988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:57.159988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:57.159988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:57.159988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:57.159988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:47:57.159988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:47:57.159988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:47:57.159988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:57.159988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:47:57.159988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:47:57.159988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'fd665a70-b047-4bf2-b775-2f93e1be084c'} Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:47:57.160832 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:47:57.162135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.163533 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d280ceb2-8c51-41c8-8f04-f7e10ad1713d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 404 to user: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:47:57.163533 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d280ceb2-8c51-41c8-8f04-f7e10ad1713d tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 404 len: 111 microversion: 2.1 time: 0.029548 Jul 20 11:47:57.163533 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 569/1149] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:47:57 2022] DELETE /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:47:57.167490 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-89076f12-3c5c-4529-982c-622c368308fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:57.168147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-89076f12-3c5c-4529-982c-622c368308fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd665a70-b047-4bf2-b775-2f93e1be084c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:57.174841 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89076f12-3c5c-4529-982c-622c368308fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:57.175287 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89076f12-3c5c-4529-982c-622c368308fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:57.176046 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89076f12-3c5c-4529-982c-622c368308fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:57.176496 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-89076f12-3c5c-4529-982c-622c368308fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:57.189609 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-89076f12-3c5c-4529-982c-622c368308fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-89076f12-3c5c-4529-982c-622c368308fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c HTTP/1.1 Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:47:57.191133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:47:57.192748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:47:57.192748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:57.192748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:57.192748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:57.192748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:57.192748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:47:57.192748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:47:57.192748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:47:57.192748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:57.192748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:47:57.192748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:47:57.192748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'fd665a70-b047-4bf2-b775-2f93e1be084c'} Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:47:57.193704 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. Jul 20 11:47:57.195188 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.197283 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-89076f12-3c5c-4529-982c-622c368308fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 404 to user: Instance fd665a70-b047-4bf2-b775-2f93e1be084c could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:47:57.197283 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-89076f12-3c5c-4529-982c-622c368308fa tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c" status: 404 len: 111 microversion: 2.1 time: 0.029626 Jul 20 11:47:57.197283 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 581/1150] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:47:57 2022] GET /compute/v2.1/servers/fd665a70-b047-4bf2-b775-2f93e1be084c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:47:57.201813 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c064e38a-fec6-4560-94d5-36c309c56571 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:57.202308 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c064e38a-fec6-4560-94d5-36c309c56571 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:57.208350 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c064e38a-fec6-4560-94d5-36c309c56571 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:57.208810 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c064e38a-fec6-4560-94d5-36c309c56571 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:57.209694 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c064e38a-fec6-4560-94d5-36c309c56571 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:57.210127 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c064e38a-fec6-4560-94d5-36c309c56571 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:57.226343 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-c064e38a-fec6-4560-94d5-36c309c56571 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c064e38a-fec6-4560-94d5-36c309c56571 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 HTTP/1.1 Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:47:57.229561 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:47:57.231168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:47:57.231168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:57.231168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:57.231168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:57.231168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:57.231168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:47:57.231168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:47:57.231168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:47:57.231168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:57.231168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:47:57.231168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:47:57.231168 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'fd4c8483-4de8-465a-8214-90e2f2b77081'} Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:47:57.232037 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:47:57.233664 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.235189 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c064e38a-fec6-4560-94d5-36c309c56571 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 404 to user: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:47:57.235189 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c064e38a-fec6-4560-94d5-36c309c56571 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 404 len: 111 microversion: 2.1 time: 0.033327 Jul 20 11:47:57.235189 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 570/1151] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:47:57 2022] DELETE /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:47:57.239806 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3cd9983d-58a4-43f6-88da-1dafe107bf43 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:57.240419 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3cd9983d-58a4-43f6-88da-1dafe107bf43 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: fd4c8483-4de8-465a-8214-90e2f2b77081] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:57.246680 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cd9983d-58a4-43f6-88da-1dafe107bf43 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:57.247120 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cd9983d-58a4-43f6-88da-1dafe107bf43 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:57.248734 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cd9983d-58a4-43f6-88da-1dafe107bf43 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:57.248734 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3cd9983d-58a4-43f6-88da-1dafe107bf43 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:57.261959 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-3cd9983d-58a4-43f6-88da-1dafe107bf43 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3cd9983d-58a4-43f6-88da-1dafe107bf43 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 HTTP/1.1 Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:47:57.263468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:47:57.265063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:47:57.265063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:57.265063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:57.265063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:57.265063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:57.265063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:47:57.265063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:47:57.265063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:47:57.265063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:57.265063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:47:57.265063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:47:57.265063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'fd4c8483-4de8-465a-8214-90e2f2b77081'} Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:47:57.266010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. Jul 20 11:47:57.267465 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:57.268760 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3cd9983d-58a4-43f6-88da-1dafe107bf43 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 404 to user: Instance fd4c8483-4de8-465a-8214-90e2f2b77081 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:47:57.268760 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3cd9983d-58a4-43f6-88da-1dafe107bf43 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081" status: 404 len: 111 microversion: 2.1 time: 0.029000 Jul 20 11:47:57.268760 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 582/1152] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:47:57 2022] GET /compute/v2.1/servers/fd4c8483-4de8-465a-8214-90e2f2b77081 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:47:58.526424 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8ecfb66-6e83-477a-80d2-b2ad992ab2b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:58.527006 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a8ecfb66-6e83-477a-80d2-b2ad992ab2b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:58.533663 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8ecfb66-6e83-477a-80d2-b2ad992ab2b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:58.534102 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8ecfb66-6e83-477a-80d2-b2ad992ab2b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:58.534852 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8ecfb66-6e83-477a-80d2-b2ad992ab2b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:58.535278 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a8ecfb66-6e83-477a-80d2-b2ad992ab2b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:58.548991 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-a8ecfb66-6e83-477a-80d2-b2ad992ab2b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8ecfb66-6e83-477a-80d2-b2ad992ab2b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf HTTP/1.1 Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:47:58.550504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:47:58.552188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:47:58.552188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:58.552188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:58.552188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:58.552188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:58.552188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:47:58.552188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:47:58.552188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:47:58.552188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:58.552188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:47:58.552188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:47:58.552188 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'e19a7062-f17c-4693-9941-040c456d9bcf'} Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:47:58.553056 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:47:58.554344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:47:58.555620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a8ecfb66-6e83-477a-80d2-b2ad992ab2b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 404 to user: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:47:58.555620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a8ecfb66-6e83-477a-80d2-b2ad992ab2b2 tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 404 len: 111 microversion: 2.1 time: 0.029961 Jul 20 11:47:58.555620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 571/1153] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:47:58 2022] DELETE /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:47:58.560505 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92a0c2f1-0d3b-44dd-a8f9-3098b1f6799c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:47:58.561161 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-92a0c2f1-0d3b-44dd-a8f9-3098b1f6799c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] [instance: e19a7062-f17c-4693-9941-040c456d9bcf] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:47:58.567598 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92a0c2f1-0d3b-44dd-a8f9-3098b1f6799c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:58.568053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92a0c2f1-0d3b-44dd-a8f9-3098b1f6799c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:58.568838 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92a0c2f1-0d3b-44dd-a8f9-3098b1f6799c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:47:58.569281 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-92a0c2f1-0d3b-44dd-a8f9-3098b1f6799c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:47:58.582357 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-92a0c2f1-0d3b-44dd-a8f9-3098b1f6799c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] HTTP exception thrown: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92a0c2f1-0d3b-44dd-a8f9-3098b1f6799c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Request method failure captured: Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf HTTP/1.1 Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-iCuuy2ZyWgWTPMiHlQoCvfW6rSDlVhXNVgCxY38bNsU_QDhMG44KlkOtmjsA8L8Efd4AlkPXZxnXfdsE5mNdElJYS_PppI7FOg1BVq03SZvYASD_3ueC5S2Ued5fQnUPMA2HJPOhIvMESG_5TZLupZ_UUIUA0HhllqLYSDcAsldAw Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:47:58.583854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:47:58.585550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4fa73c956fe44a59272f727320743e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4fa73c956fe44a59272f727320743e0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4fa73c956fe44a59272f727320743e0"}]}] Jul 20 11:47:58.585550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:58.585550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: d4fa73c956fe44a59272f727320743e0 Jul 20 11:47:58.585550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1233156599 Jul 20 11:47:58.585550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:58.585550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:47:58.585550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:47:58.585550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 54c7d577e64f48cab8c331ff192be0a6 Jul 20 11:47:58.585550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeNegativeTest-1233156599-project Jul 20 11:47:58.585550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:47:58.585550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:47:58.585550 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'e19a7062-f17c-4693-9941-040c456d9bcf'} Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:47:58.586359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. Jul 20 11:47:58.588163 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:47:58.589413 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-92a0c2f1-0d3b-44dd-a8f9-3098b1f6799c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] Returning 404 to user: Instance e19a7062-f17c-4693-9941-040c456d9bcf could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:47:58.589413 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-92a0c2f1-0d3b-44dd-a8f9-3098b1f6799c tempest-AttachVolumeNegativeTest-1233156599 tempest-AttachVolumeNegativeTest-1233156599-project] 10.222.0.43 "GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf" status: 404 len: 111 microversion: 2.1 time: 0.028597 Jul 20 11:47:58.589413 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 583/1154] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:47:58 2022] GET /compute/v2.1/servers/e19a7062-f17c-4693-9941-040c456d9bcf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:48:04.263991 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a4246359-21ed-42e8-9564-2e02e2cfed39 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Action: 'create', calling method: .version_select at 0x7f44e01b4a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1572390340"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:48:04.925320 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a4246359-21ed-42e8-9564-2e02e2cfed39 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.773723 Jul 20 11:48:04.925941 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 572/1155] 10.222.0.43 () {60 vars in 1154 bytes} [Wed Jul 20 11:48:04 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 775 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 11:48:04.937426 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-181b9cef-95fe-4173-8092-8e393e8ebc23 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e38efd30>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:04.984682 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-181b9cef-95fe-4173-8092-8e393e8ebc23 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026" status: 200 len: 345 microversion: 2.1 time: 0.050944 Jul 20 11:48:04.985278 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 584/1156] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:48:04 2022] GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:48:05.997292 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dcbcb572-c105-4ff7-8034-ed137635fe56 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e01574c0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:06.042044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dcbcb572-c105-4ff7-8034-ed137635fe56 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026" status: 200 len: 345 microversion: 2.1 time: 0.049649 Jul 20 11:48:06.042606 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 573/1157] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:48:05 2022] GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:48:07.054926 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8521dd66-e03a-4bdb-b517-7f1300f63c59 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44dae095e0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:07.100150 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8521dd66-e03a-4bdb-b517-7f1300f63c59 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026" status: 200 len: 346 microversion: 2.1 time: 0.049442 Jul 20 11:48:07.100711 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 585/1158] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:48:07 2022] GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:48:07.112862 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8fafa5a7-8aa4-49ff-b324-eaaa16cfb89a tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Action: 'create', calling method: .version_select at 0x7f44e020fd30>, body: {"snapshot": {"volume_id": "37d2166c-5eec-4981-b8a4-5710264f2026", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-424103522"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:48:07.550817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8fafa5a7-8aa4-49ff-b324-eaaa16cfb89a tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.443045 Jul 20 11:48:07.551427 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 574/1159] 10.222.0.43 () {60 vars in 1161 bytes} [Wed Jul 20 11:48:07 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:48:07.562109 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ee59288a-7d3e-403e-bd85-32c7eb8a1582 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e38d5e50>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:07.591749 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ee59288a-7d3e-403e-bd85-32c7eb8a1582 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898" status: 200 len: 286 microversion: 2.1 time: 0.033805 Jul 20 11:48:07.592325 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 586/1160] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 11:48:07 2022] GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:48:07.601894 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-481165c0-290d-4596-a9c2-1cbfd479bd3c tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e043e940>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:07.642989 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-481165c0-290d-4596-a9c2-1cbfd479bd3c tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.044863 Jul 20 11:48:07.643638 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 575/1161] 10.222.0.43 () {58 vars in 1139 bytes} [Wed Jul 20 11:48:07 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:48:07.653591 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-48aec765-0bd7-4875-ae8d-68557c82b5cd tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e0339280>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:07.683372 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-48aec765-0bd7-4875-ae8d-68557c82b5cd tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898" status: 200 len: 286 microversion: 2.1 time: 0.033557 Jul 20 11:48:07.683983 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 587/1162] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 11:48:07 2022] GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:48:08.692348 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:48:08.693153 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:48:08.697082 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c58d1e7f-d7e5-4f97-8455-53f8c97046fd tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44daf2f1f0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:08.725774 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c58d1e7f-d7e5-4f97-8455-53f8c97046fd tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898" status: 200 len: 286 microversion: 2.1 time: 0.034550 Jul 20 11:48:08.726324 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 576/1163] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 11:48:08 2022] GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:48:09.734701 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:48:09.735453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:48:09.739260 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9479dfef-b207-4588-aed2-bf0c55985ba0 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e38efca0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:09.768410 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9479dfef-b207-4588-aed2-bf0c55985ba0 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898" status: 200 len: 286 microversion: 2.1 time: 0.034857 Jul 20 11:48:09.769009 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 588/1164] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 11:48:09 2022] GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:48:10.781950 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4b85a2d7-3fcf-4f70-bcfd-bfeb3a158d3b tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e020f9d0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:10.810874 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4b85a2d7-3fcf-4f70-bcfd-bfeb3a158d3b tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898" status: 200 len: 286 microversion: 2.1 time: 0.034126 Jul 20 11:48:10.811426 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 577/1165] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 11:48:10 2022] GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:48:11.823299 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-99b46313-e628-46ab-b20f-1f6e8232241a tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e38d5040>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:11.853918 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-99b46313-e628-46ab-b20f-1f6e8232241a tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898" status: 200 len: 286 microversion: 2.1 time: 0.035243 Jul 20 11:48:11.854477 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 589/1166] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 11:48:11 2022] GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:48:12.870497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6d4183c0-696c-4e00-a83a-cf4a8f2904cd tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e011f790>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:12.884270 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-799ea99e-2fb2-433a-9869-c6087cff13b0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:12.891528 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-799ea99e-2fb2-433a-9869-c6087cff13b0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:12.891528 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-799ea99e-2fb2-433a-9869-c6087cff13b0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:12.892018 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-799ea99e-2fb2-433a-9869-c6087cff13b0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:12.892846 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-799ea99e-2fb2-433a-9869-c6087cff13b0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:12.893265 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-799ea99e-2fb2-433a-9869-c6087cff13b0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:12.901525 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6d4183c0-696c-4e00-a83a-cf4a8f2904cd tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898" status: 200 len: 287 microversion: 2.1 time: 0.036121 Jul 20 11:48:12.902254 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 578/1167] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 11:48:12 2022] GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:48:12.911962 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1fc114b8-ec22-4bd1-ac82-5edf5bd4f635 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e0157ca0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:12.981008 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-799ea99e-2fb2-433a-9869-c6087cff13b0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lazy-loading 'services' on Instance uuid a026878a-994a-4ce9-8c8c-550e0631ef69 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:48:13.098833 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1fc114b8-ec22-4bd1-ac82-5edf5bd4f635 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898" status: 202 len: 0 microversion: 2.1 time: 0.190284 Jul 20 11:48:13.103841 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 579/1168] 10.222.0.43 () {58 vars in 1253 bytes} [Wed Jul 20 11:48:12 2022] DELETE /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:48:13.107587 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba679bb5-fec6-4d4f-ba3a-9289aa4592d4 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e022ee50>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:13.141336 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba679bb5-fec6-4d4f-ba3a-9289aa4592d4 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898" status: 200 len: 286 microversion: 2.1 time: 0.037390 Jul 20 11:48:13.142089 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 580/1169] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 11:48:13 2022] GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:48:13.308715 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-799ea99e-2fb2-433a-9869-c6087cff13b0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/os-volume_attachments/b52355bf-0fe0-48ef-9181-e20abc419a0a" status: 202 len: 0 microversion: 2.1 time: 0.428616 Jul 20 11:48:13.309345 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 590/1170] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 11:48:12 2022] DELETE /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/os-volume_attachments/b52355bf-0fe0-48ef-9181-e20abc419a0a => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:48:14.159039 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65476181-ccaf-472b-8fd3-a3f61563021c tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e020f790>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:14.185745 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-65476181-ccaf-472b-8fd3-a3f61563021c tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] HTTP exception thrown: Snapshot 5be83be8-09ff-40df-941c-0d4c55fe6898 could not be found. Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65476181-ccaf-472b-8fd3-a3f61563021c tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Request method failure captured: Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898 HTTP/1.1 Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-t09L0-tz6Tl9VMIyVHLbxnnvT_swYCsdYfW1axaRjqSnRqLdOaOfodGKt5UzM7AzSkZADiHEdTaIeegjFXk4MoRPn9vd_e9CbOlJnbLQ51hZ28mjHijKSKbMu_qb9DdOGR25LtrFbUK6RAC9E851meVeLyK5xxexRKsoqcy3h5Plk Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: ba301c9ca5f742b4a222ee01ccd90a0f Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-634120518 Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:48:14.193520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:48:14.195177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba301c9ca5f742b4a222ee01ccd90a0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba301c9ca5f742b4a222ee01ccd90a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba301c9ca5f742b4a222ee01ccd90a0f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba301c9ca5f742b4a222ee01ccd90a0f"}]}] Jul 20 11:48:14.195177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesSnapshotsTestJSON-634120518 Jul 20 11:48:14.195177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: ba301c9ca5f742b4a222ee01ccd90a0f Jul 20 11:48:14.195177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-634120518 Jul 20 11:48:14.195177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesSnapshotsTestJSON-634120518-project Jul 20 11:48:14.195177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:48:14.195177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:48:14.195177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 9685cedf20ce415db929c8af7560431f Jul 20 11:48:14.195177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesSnapshotsTestJSON-634120518-project Jul 20 11:48:14.195177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: Jul 20 11:48:14.195177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Snapshot 5be83be8-09ff-40df-941c-0d4c55fe6898 could not be found. Jul 20 11:48:14.195177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': '5be83be8-09ff-40df-941c-0d4c55fe6898'} Jul 20 11:48:14.195177 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5be83be8-09ff-40df-941c-0d4c55fe6898 could not be found. (HTTP 404) (Request-ID: req-fdf43bcf-637e-4a1c-9d9d-89f54000f755) Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:48:14.196162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:48:14.197397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5be83be8-09ff-40df-941c-0d4c55fe6898 could not be found. Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 11:48:14.198809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:48:14.200242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5be83be8-09ff-40df-941c-0d4c55fe6898 could not be found. Jul 20 11:48:14.200242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:48:14.200242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:48:14.200242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:48:14.200242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:14.200242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:48:14.200242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:48:14.200242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:48:14.200242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:48:14.200242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5be83be8-09ff-40df-941c-0d4c55fe6898 could not be found. Jul 20 11:48:14.200242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:48:14.200242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-65476181-ccaf-472b-8fd3-a3f61563021c tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Returning 404 to user: Snapshot 5be83be8-09ff-40df-941c-0d4c55fe6898 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:48:14.200242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-65476181-ccaf-472b-8fd3-a3f61563021c tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898" status: 404 len: 111 microversion: 2.1 time: 0.040561 Jul 20 11:48:14.201344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 581/1171] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 11:48:14 2022] GET /compute/v2.1/os-snapshots/5be83be8-09ff-40df-941c-0d4c55fe6898 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:48:14.204696 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50d4ccf3-4de7-4337-a2d2-5ce59f7cd961 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e38d5550>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:14.464068 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-50d4ccf3-4de7-4337-a2d2-5ce59f7cd961 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026" status: 202 len: 0 microversion: 2.1 time: 0.263537 Jul 20 11:48:14.466484 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 591/1172] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 11:48:14 2022] DELETE /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:48:14.473668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1f38679c-a05b-4c97-ae4a-e19d53531ef3 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e01c0af0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:14.541734 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1f38679c-a05b-4c97-ae4a-e19d53531ef3 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026" status: 200 len: 345 microversion: 2.1 time: 0.071947 Jul 20 11:48:14.542303 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 582/1173] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:48:14 2022] GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026 => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:48:15.554166 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-01b6877a-96b3-4848-93b0-ac919f6c5462 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44daf09670>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:15.566554 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ba23f29b-8cb7-4917-b14c-80681ebcffc6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:48:15.573314 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba23f29b-8cb7-4917-b14c-80681ebcffc6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:15.573754 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ba23f29b-8cb7-4917-b14c-80681ebcffc6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:15.582206 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-01b6877a-96b3-4848-93b0-ac919f6c5462 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] HTTP exception thrown: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-01b6877a-96b3-4848-93b0-ac919f6c5462 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Request method failure captured: Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026 HTTP/1.1 Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-t09L0-tz6Tl9VMIyVHLbxnnvT_swYCsdYfW1axaRjqSnRqLdOaOfodGKt5UzM7AzSkZADiHEdTaIeegjFXk4MoRPn9vd_e9CbOlJnbLQ51hZ28mjHijKSKbMu_qb9DdOGR25LtrFbUK6RAC9E851meVeLyK5xxexRKsoqcy3h5Plk Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: ba301c9ca5f742b4a222ee01ccd90a0f Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-634120518 Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:48:15.585246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:48:15.589453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba301c9ca5f742b4a222ee01ccd90a0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba301c9ca5f742b4a222ee01ccd90a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba301c9ca5f742b4a222ee01ccd90a0f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba301c9ca5f742b4a222ee01ccd90a0f"}]}] Jul 20 11:48:15.589453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotsTestJSON-634120518 Jul 20 11:48:15.589453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: ba301c9ca5f742b4a222ee01ccd90a0f Jul 20 11:48:15.589453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-634120518 Jul 20 11:48:15.589453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotsTestJSON-634120518-project Jul 20 11:48:15.589453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:48:15.589453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:48:15.589453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 9685cedf20ce415db929c8af7560431f Jul 20 11:48:15.589453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotsTestJSON-634120518-project Jul 20 11:48:15.589453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: Jul 20 11:48:15.589453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.589453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': '37d2166c-5eec-4981-b8a4-5710264f2026'} Jul 20 11:48:15.589453 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. (HTTP 404) (Request-ID: req-b985d568-14e4-4202-9d26-ba25635bf5dc) Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:48:15.591257 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:48:15.592486 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 11:48:15.593857 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-01b6877a-96b3-4848-93b0-ac919f6c5462 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Returning 404 to user: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-01b6877a-96b3-4848-93b0-ac919f6c5462 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026" status: 404 len: 109 microversion: 2.1 time: 0.036262 Jul 20 11:48:15.595349 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 592/1174] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:48:15 2022] GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:48:15.598359 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ba23f29b-8cb7-4917-b14c-80681ebcffc6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Going to try to stop instance {{(pid=124830) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 11:48:15.611331 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e1e38391-ee3c-4d9c-902f-6f200d1a4119 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44e38d5940>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:15.640173 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-e1e38391-ee3c-4d9c-902f-6f200d1a4119 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] HTTP exception thrown: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e1e38391-ee3c-4d9c-902f-6f200d1a4119 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Request method failure captured: Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026 HTTP/1.1 Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-t09L0-tz6Tl9VMIyVHLbxnnvT_swYCsdYfW1axaRjqSnRqLdOaOfodGKt5UzM7AzSkZADiHEdTaIeegjFXk4MoRPn9vd_e9CbOlJnbLQ51hZ28mjHijKSKbMu_qb9DdOGR25LtrFbUK6RAC9E851meVeLyK5xxexRKsoqcy3h5Plk Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: ba301c9ca5f742b4a222ee01ccd90a0f Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-634120518 Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:48:15.642153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:48:15.643854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba301c9ca5f742b4a222ee01ccd90a0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba301c9ca5f742b4a222ee01ccd90a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba301c9ca5f742b4a222ee01ccd90a0f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba301c9ca5f742b4a222ee01ccd90a0f"}]}] Jul 20 11:48:15.643854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotsTestJSON-634120518 Jul 20 11:48:15.643854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: ba301c9ca5f742b4a222ee01ccd90a0f Jul 20 11:48:15.643854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-634120518 Jul 20 11:48:15.643854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotsTestJSON-634120518-project Jul 20 11:48:15.643854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:48:15.643854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:48:15.643854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 9685cedf20ce415db929c8af7560431f Jul 20 11:48:15.643854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotsTestJSON-634120518-project Jul 20 11:48:15.643854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: Jul 20 11:48:15.643854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.643854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': '37d2166c-5eec-4981-b8a4-5710264f2026'} Jul 20 11:48:15.643854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. (HTTP 404) (Request-ID: req-63c779d2-6ec8-4e26-a43b-aa60e12a8e09) Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:48:15.645081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 11:48:15.646533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 11:48:15.648207 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e1e38391-ee3c-4d9c-902f-6f200d1a4119 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Returning 404 to user: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e1e38391-ee3c-4d9c-902f-6f200d1a4119 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026" status: 404 len: 109 microversion: 2.1 time: 0.036325 Jul 20 11:48:15.650416 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 593/1175] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 11:48:15 2022] DELETE /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:48:15.652262 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b599f2de-59be-457f-be91-7f9d4481d7d9 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Calling method '.version_select at 0x7f44dae5db80>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:15.679917 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-b599f2de-59be-457f-be91-7f9d4481d7d9 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] HTTP exception thrown: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b599f2de-59be-457f-be91-7f9d4481d7d9 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Request method failure captured: Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026 HTTP/1.1 Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-t09L0-tz6Tl9VMIyVHLbxnnvT_swYCsdYfW1axaRjqSnRqLdOaOfodGKt5UzM7AzSkZADiHEdTaIeegjFXk4MoRPn9vd_e9CbOlJnbLQ51hZ28mjHijKSKbMu_qb9DdOGR25LtrFbUK6RAC9E851meVeLyK5xxexRKsoqcy3h5Plk Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: ba301c9ca5f742b4a222ee01ccd90a0f Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-634120518 Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:48:15.688217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:48:15.689819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba301c9ca5f742b4a222ee01ccd90a0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba301c9ca5f742b4a222ee01ccd90a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba301c9ca5f742b4a222ee01ccd90a0f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba301c9ca5f742b4a222ee01ccd90a0f"}]}] Jul 20 11:48:15.689819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesSnapshotsTestJSON-634120518 Jul 20 11:48:15.689819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: ba301c9ca5f742b4a222ee01ccd90a0f Jul 20 11:48:15.689819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-634120518 Jul 20 11:48:15.689819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesSnapshotsTestJSON-634120518-project Jul 20 11:48:15.689819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:48:15.689819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:48:15.689819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 9685cedf20ce415db929c8af7560431f Jul 20 11:48:15.689819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesSnapshotsTestJSON-634120518-project Jul 20 11:48:15.689819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: Jul 20 11:48:15.689819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.689819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': '37d2166c-5eec-4981-b8a4-5710264f2026'} Jul 20 11:48:15.689819 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. (HTTP 404) (Request-ID: req-4837bd65-0a27-4405-9db7-6ce217bfc9af) Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:48:15.690832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:48:15.692312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 11:48:15.694246 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b599f2de-59be-457f-be91-7f9d4481d7d9 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] Returning 404 to user: Volume 37d2166c-5eec-4981-b8a4-5710264f2026 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b599f2de-59be-457f-be91-7f9d4481d7d9 tempest-VolumesSnapshotsTestJSON-634120518 tempest-VolumesSnapshotsTestJSON-634120518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026" status: 404 len: 109 microversion: 2.1 time: 0.035173 Jul 20 11:48:15.695965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 594/1176] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:48:15 2022] GET /compute/v2.1/os-volumes/37d2166c-5eec-4981-b8a4-5710264f2026 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:48:15.781341 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ba23f29b-8cb7-4917-b14c-80681ebcffc6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "POST /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/action" status: 202 len: 0 microversion: 2.1 time: 0.218664 Jul 20 11:48:15.782173 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 583/1177] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:48:15 2022] POST /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:48:15.797414 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3b76df42-34a4-46b5-bc5d-ed6fdc59b6be tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:15.797414 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3b76df42-34a4-46b5-bc5d-ed6fdc59b6be tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:15.797939 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b76df42-34a4-46b5-bc5d-ed6fdc59b6be tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:15.798373 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b76df42-34a4-46b5-bc5d-ed6fdc59b6be tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:15.799154 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b76df42-34a4-46b5-bc5d-ed6fdc59b6be tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:15.799594 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3b76df42-34a4-46b5-bc5d-ed6fdc59b6be tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:15.947521 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3b76df42-34a4-46b5-bc5d-ed6fdc59b6be tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:15.955101 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3b76df42-34a4-46b5-bc5d-ed6fdc59b6be tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1675 microversion: 2.1 time: 0.169044 Jul 20 11:48:15.959738 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 595/1178] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:15 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:48:16.973984 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a7a0d6c0-14e3-4cea-904e-535ddb1faf68 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:16.974787 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a7a0d6c0-14e3-4cea-904e-535ddb1faf68 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:16.983331 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7a0d6c0-14e3-4cea-904e-535ddb1faf68 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:16.983909 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7a0d6c0-14e3-4cea-904e-535ddb1faf68 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:16.984812 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7a0d6c0-14e3-4cea-904e-535ddb1faf68 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:16.985400 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a7a0d6c0-14e3-4cea-904e-535ddb1faf68 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:17.125588 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a7a0d6c0-14e3-4cea-904e-535ddb1faf68 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:17.133201 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a7a0d6c0-14e3-4cea-904e-535ddb1faf68 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1675 microversion: 2.1 time: 0.164425 Jul 20 11:48:17.139152 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 584/1179] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:16 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:48:18.149576 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f060b2c8-e3fd-4193-8686-e5bee31802a2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:18.150176 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f060b2c8-e3fd-4193-8686-e5bee31802a2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:18.157265 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f060b2c8-e3fd-4193-8686-e5bee31802a2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:18.162133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f060b2c8-e3fd-4193-8686-e5bee31802a2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:18.162133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f060b2c8-e3fd-4193-8686-e5bee31802a2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:18.162133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f060b2c8-e3fd-4193-8686-e5bee31802a2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:18.290583 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f060b2c8-e3fd-4193-8686-e5bee31802a2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:18.297962 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f060b2c8-e3fd-4193-8686-e5bee31802a2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1675 microversion: 2.1 time: 0.152225 Jul 20 11:48:18.298523 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 596/1180] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:18 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:48:19.315155 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e82034dd-8f64-497c-b7b5-c4e43ff20a02 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:19.315880 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e82034dd-8f64-497c-b7b5-c4e43ff20a02 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:19.322985 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e82034dd-8f64-497c-b7b5-c4e43ff20a02 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:19.323448 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e82034dd-8f64-497c-b7b5-c4e43ff20a02 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:19.324209 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e82034dd-8f64-497c-b7b5-c4e43ff20a02 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:19.324639 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-e82034dd-8f64-497c-b7b5-c4e43ff20a02 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:19.451908 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e82034dd-8f64-497c-b7b5-c4e43ff20a02 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:19.459882 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e82034dd-8f64-497c-b7b5-c4e43ff20a02 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1675 microversion: 2.1 time: 0.148278 Jul 20 11:48:19.463463 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 585/1181] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:19 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:48:20.476800 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-041f3d4a-e148-4ef4-b837-0cd2391fdc77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:20.482813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-041f3d4a-e148-4ef4-b837-0cd2391fdc77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:20.483844 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-041f3d4a-e148-4ef4-b837-0cd2391fdc77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:20.484295 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-041f3d4a-e148-4ef4-b837-0cd2391fdc77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:20.485100 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-041f3d4a-e148-4ef4-b837-0cd2391fdc77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:20.485542 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-041f3d4a-e148-4ef4-b837-0cd2391fdc77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:20.616454 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-041f3d4a-e148-4ef4-b837-0cd2391fdc77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:20.623938 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-041f3d4a-e148-4ef4-b837-0cd2391fdc77 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1675 microversion: 2.1 time: 0.151016 Jul 20 11:48:20.624504 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 597/1182] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:20 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:48:21.649679 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-64221a9f-bf71-4815-9335-14d7554af5de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:21.650382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-64221a9f-bf71-4815-9335-14d7554af5de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:21.657031 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64221a9f-bf71-4815-9335-14d7554af5de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:21.657477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64221a9f-bf71-4815-9335-14d7554af5de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:21.658243 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64221a9f-bf71-4815-9335-14d7554af5de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:21.658676 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64221a9f-bf71-4815-9335-14d7554af5de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:21.787694 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-64221a9f-bf71-4815-9335-14d7554af5de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:21.795810 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-64221a9f-bf71-4815-9335-14d7554af5de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1675 microversion: 2.1 time: 0.150484 Jul 20 11:48:21.796383 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 586/1183] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:21 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:48:22.812854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-66037589-bd7f-4b90-97b5-ef0268c333bc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:22.813509 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-66037589-bd7f-4b90-97b5-ef0268c333bc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:22.819975 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66037589-bd7f-4b90-97b5-ef0268c333bc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:22.820426 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66037589-bd7f-4b90-97b5-ef0268c333bc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:22.821217 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66037589-bd7f-4b90-97b5-ef0268c333bc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:22.821651 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-66037589-bd7f-4b90-97b5-ef0268c333bc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:22.991820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-66037589-bd7f-4b90-97b5-ef0268c333bc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:23.000580 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-66037589-bd7f-4b90-97b5-ef0268c333bc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1675 microversion: 2.1 time: 0.191638 Jul 20 11:48:23.001334 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 598/1184] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:22 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:48:24.017131 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c94165c7-e7a0-4856-8714-4dca80cd7dd6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:24.017747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c94165c7-e7a0-4856-8714-4dca80cd7dd6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:24.025127 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c94165c7-e7a0-4856-8714-4dca80cd7dd6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:24.025127 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c94165c7-e7a0-4856-8714-4dca80cd7dd6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:24.025572 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c94165c7-e7a0-4856-8714-4dca80cd7dd6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:24.026014 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c94165c7-e7a0-4856-8714-4dca80cd7dd6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:24.165514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c94165c7-e7a0-4856-8714-4dca80cd7dd6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:24.173008 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c94165c7-e7a0-4856-8714-4dca80cd7dd6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1675 microversion: 2.1 time: 0.159786 Jul 20 11:48:24.173575 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 587/1185] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:24 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:48:25.189584 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eef03e86-9459-4f99-8947-025bcf682d57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:25.190213 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eef03e86-9459-4f99-8947-025bcf682d57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:25.196606 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eef03e86-9459-4f99-8947-025bcf682d57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:25.197088 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eef03e86-9459-4f99-8947-025bcf682d57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:25.197889 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eef03e86-9459-4f99-8947-025bcf682d57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:25.198329 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eef03e86-9459-4f99-8947-025bcf682d57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:25.334803 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-eef03e86-9459-4f99-8947-025bcf682d57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:25.342742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eef03e86-9459-4f99-8947-025bcf682d57 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1675 microversion: 2.1 time: 0.157031 Jul 20 11:48:25.343308 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 599/1186] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:25 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:48:26.359831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-db3fa9f3-f22c-485e-8aaa-3ac8daba00e4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:26.360424 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-db3fa9f3-f22c-485e-8aaa-3ac8daba00e4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:26.366850 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db3fa9f3-f22c-485e-8aaa-3ac8daba00e4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:26.367294 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db3fa9f3-f22c-485e-8aaa-3ac8daba00e4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:26.368609 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db3fa9f3-f22c-485e-8aaa-3ac8daba00e4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:26.369065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-db3fa9f3-f22c-485e-8aaa-3ac8daba00e4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:26.502739 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-db3fa9f3-f22c-485e-8aaa-3ac8daba00e4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:26.510275 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-db3fa9f3-f22c-485e-8aaa-3ac8daba00e4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1675 microversion: 2.1 time: 0.154233 Jul 20 11:48:26.510845 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 588/1187] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:26 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:48:27.527789 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-99604e31-4354-4273-81d9-9a0b62fca816 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:27.528541 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-99604e31-4354-4273-81d9-9a0b62fca816 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:27.535359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99604e31-4354-4273-81d9-9a0b62fca816 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:27.535809 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99604e31-4354-4273-81d9-9a0b62fca816 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:27.536586 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99604e31-4354-4273-81d9-9a0b62fca816 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:27.537057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99604e31-4354-4273-81d9-9a0b62fca816 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:27.672671 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-99604e31-4354-4273-81d9-9a0b62fca816 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:27.680127 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-99604e31-4354-4273-81d9-9a0b62fca816 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1652 microversion: 2.1 time: 0.156765 Jul 20 11:48:27.680744 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 600/1188] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:27 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1652 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:48:27.696521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-9192607a-a467-4e28-858f-ea2273616b99 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:48:27.703244 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9192607a-a467-4e28-858f-ea2273616b99 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:27.703692 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-9192607a-a467-4e28-858f-ea2273616b99 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:27.725795 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-9192607a-a467-4e28-858f-ea2273616b99 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Going to try to start instance {{(pid=124830) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 11:48:27.952622 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-9192607a-a467-4e28-858f-ea2273616b99 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "POST /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/action" status: 202 len: 0 microversion: 2.1 time: 0.259926 Jul 20 11:48:27.953274 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 589/1189] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 11:48:27 2022] POST /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:48:27.962097 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2207463d-03db-472f-9df4-d094696bb105 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:27.962837 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2207463d-03db-472f-9df4-d094696bb105 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:27.968955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2207463d-03db-472f-9df4-d094696bb105 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:27.969386 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2207463d-03db-472f-9df4-d094696bb105 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:27.970151 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2207463d-03db-472f-9df4-d094696bb105 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:27.970596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2207463d-03db-472f-9df4-d094696bb105 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:28.101557 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2207463d-03db-472f-9df4-d094696bb105 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:28.110805 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2207463d-03db-472f-9df4-d094696bb105 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1661 microversion: 2.1 time: 0.153104 Jul 20 11:48:28.111362 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 601/1190] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:27 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1661 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:48:29.128259 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-de5f0067-bf63-4abb-88c9-a41df2a0013b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:29.128986 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-de5f0067-bf63-4abb-88c9-a41df2a0013b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:29.135404 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de5f0067-bf63-4abb-88c9-a41df2a0013b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:29.138098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de5f0067-bf63-4abb-88c9-a41df2a0013b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:29.138098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de5f0067-bf63-4abb-88c9-a41df2a0013b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:29.138098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-de5f0067-bf63-4abb-88c9-a41df2a0013b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:29.270327 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-de5f0067-bf63-4abb-88c9-a41df2a0013b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:29.278140 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-de5f0067-bf63-4abb-88c9-a41df2a0013b tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1661 microversion: 2.1 time: 0.154533 Jul 20 11:48:29.278712 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 590/1191] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:29 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1661 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:48:30.295445 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d3a8e647-ade9-48d3-b9c2-471974ab5b9e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:30.296057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d3a8e647-ade9-48d3-b9c2-471974ab5b9e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:30.302694 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3a8e647-ade9-48d3-b9c2-471974ab5b9e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:30.303426 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3a8e647-ade9-48d3-b9c2-471974ab5b9e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:30.304206 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3a8e647-ade9-48d3-b9c2-471974ab5b9e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:30.304645 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3a8e647-ade9-48d3-b9c2-471974ab5b9e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:30.436221 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d3a8e647-ade9-48d3-b9c2-471974ab5b9e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:30.443729 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d3a8e647-ade9-48d3-b9c2-471974ab5b9e tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1665 microversion: 2.1 time: 0.152108 Jul 20 11:48:30.444294 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 602/1192] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:48:30 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:48:48.598434 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d4f4d1ba-88dd-4367-86c7-355643c0870d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:48.599467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d4f4d1ba-88dd-4367-86c7-355643c0870d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:48.601909 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=16 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:48:48.602581 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:48:48.607401 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4f4d1ba-88dd-4367-86c7-355643c0870d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:48.614596 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4f4d1ba-88dd-4367-86c7-355643c0870d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:48.614596 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4f4d1ba-88dd-4367-86c7-355643c0870d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:48.614596 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d4f4d1ba-88dd-4367-86c7-355643c0870d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:48.640224 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d4f4d1ba-88dd-4367-86c7-355643c0870d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045901 Jul 20 11:48:48.640773 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 591/1193] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jul 20 11:48:48 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:48:48.697339 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-61f146bf-95f9-4491-adfd-8ea0f9cd6d2c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:48.697846 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-61f146bf-95f9-4491-adfd-8ea0f9cd6d2c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:48.699907 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=18 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:48:48.700559 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:48:48.705331 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61f146bf-95f9-4491-adfd-8ea0f9cd6d2c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:48.711318 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61f146bf-95f9-4491-adfd-8ea0f9cd6d2c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:48.711318 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61f146bf-95f9-4491-adfd-8ea0f9cd6d2c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:48.711318 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-61f146bf-95f9-4491-adfd-8ea0f9cd6d2c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:48.730575 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-61f146bf-95f9-4491-adfd-8ea0f9cd6d2c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:48:49.000517 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-61f146bf-95f9-4491-adfd-8ea0f9cd6d2c tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 204 len: 0 microversion: 2.20 time: 0.307368 Jul 20 11:48:49.001229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 603/1194] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jul 20 11:48:48 2022] DELETE /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:48:49.013550 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4bfd15ca-92b6-44f7-bd2e-26218980f267 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:49.014150 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4bfd15ca-92b6-44f7-bd2e-26218980f267 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:49.020688 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bfd15ca-92b6-44f7-bd2e-26218980f267 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:49.021181 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bfd15ca-92b6-44f7-bd2e-26218980f267 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:49.021884 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bfd15ca-92b6-44f7-bd2e-26218980f267 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:49.022309 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4bfd15ca-92b6-44f7-bd2e-26218980f267 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:49.153372 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4bfd15ca-92b6-44f7-bd2e-26218980f267 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:49.161375 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4bfd15ca-92b6-44f7-bd2e-26218980f267 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:49.162872 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-4bfd15ca-92b6-44f7-bd2e-26218980f267 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:49.164113 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4bfd15ca-92b6-44f7-bd2e-26218980f267 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.154310 Jul 20 11:48:49.164948 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 592/1195] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:48:49 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:48:50.184006 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5225372e-3262-47b2-bc10-e8f8cfd798f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:50.184702 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5225372e-3262-47b2-bc10-e8f8cfd798f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:50.191471 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5225372e-3262-47b2-bc10-e8f8cfd798f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:50.191947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5225372e-3262-47b2-bc10-e8f8cfd798f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:50.192697 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5225372e-3262-47b2-bc10-e8f8cfd798f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:50.193165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5225372e-3262-47b2-bc10-e8f8cfd798f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:50.342885 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5225372e-3262-47b2-bc10-e8f8cfd798f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:50.350372 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5225372e-3262-47b2-bc10-e8f8cfd798f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:50.352023 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5225372e-3262-47b2-bc10-e8f8cfd798f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:50.353825 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5225372e-3262-47b2-bc10-e8f8cfd798f8 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.174751 Jul 20 11:48:50.354383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 604/1196] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:48:50 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:48:51.392613 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c43fef17-ce9d-42fd-b4c2-5f8cb9b9a78f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:51.393270 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c43fef17-ce9d-42fd-b4c2-5f8cb9b9a78f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:51.400349 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c43fef17-ce9d-42fd-b4c2-5f8cb9b9a78f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:51.400800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c43fef17-ce9d-42fd-b4c2-5f8cb9b9a78f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:51.401563 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c43fef17-ce9d-42fd-b4c2-5f8cb9b9a78f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:51.401997 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c43fef17-ce9d-42fd-b4c2-5f8cb9b9a78f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:51.527344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c43fef17-ce9d-42fd-b4c2-5f8cb9b9a78f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:51.535571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c43fef17-ce9d-42fd-b4c2-5f8cb9b9a78f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:51.537115 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c43fef17-ce9d-42fd-b4c2-5f8cb9b9a78f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:51.538278 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c43fef17-ce9d-42fd-b4c2-5f8cb9b9a78f tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.149604 Jul 20 11:48:51.538839 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 593/1197] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:48:51 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:48:51.770680 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:48:51.770902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Wed Jul 20 11:48:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:48:52.556373 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f847d11b-aadb-4b83-9b32-792ff479f0c0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:52.557005 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f847d11b-aadb-4b83-9b32-792ff479f0c0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:52.563545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f847d11b-aadb-4b83-9b32-792ff479f0c0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:52.564006 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f847d11b-aadb-4b83-9b32-792ff479f0c0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:52.564765 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f847d11b-aadb-4b83-9b32-792ff479f0c0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:52.565216 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f847d11b-aadb-4b83-9b32-792ff479f0c0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:52.732619 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f847d11b-aadb-4b83-9b32-792ff479f0c0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:52.740869 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f847d11b-aadb-4b83-9b32-792ff479f0c0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:52.742412 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-f847d11b-aadb-4b83-9b32-792ff479f0c0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:52.743582 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f847d11b-aadb-4b83-9b32-792ff479f0c0 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.191196 Jul 20 11:48:52.744136 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 605/1198] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:48:52 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:48:53.761877 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7def6cb3-b141-4028-8edc-f1f12080f1fc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:53.762485 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7def6cb3-b141-4028-8edc-f1f12080f1fc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:53.768908 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7def6cb3-b141-4028-8edc-f1f12080f1fc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:53.769360 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7def6cb3-b141-4028-8edc-f1f12080f1fc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:53.770123 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7def6cb3-b141-4028-8edc-f1f12080f1fc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:53.770557 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7def6cb3-b141-4028-8edc-f1f12080f1fc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:53.903035 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7def6cb3-b141-4028-8edc-f1f12080f1fc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:53.911284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7def6cb3-b141-4028-8edc-f1f12080f1fc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:53.915831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-7def6cb3-b141-4028-8edc-f1f12080f1fc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:53.915831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7def6cb3-b141-4028-8edc-f1f12080f1fc tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.156047 Jul 20 11:48:53.915831 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 594/1199] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:48:53 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:48:54.933816 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e033e1fa-dd77-4604-83b0-aacfa453b7a2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:54.934343 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e033e1fa-dd77-4604-83b0-aacfa453b7a2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:54.940888 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e033e1fa-dd77-4604-83b0-aacfa453b7a2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:54.941340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e033e1fa-dd77-4604-83b0-aacfa453b7a2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:54.942108 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e033e1fa-dd77-4604-83b0-aacfa453b7a2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:54.942547 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e033e1fa-dd77-4604-83b0-aacfa453b7a2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:55.071509 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e033e1fa-dd77-4604-83b0-aacfa453b7a2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:55.079284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e033e1fa-dd77-4604-83b0-aacfa453b7a2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:55.080808 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e033e1fa-dd77-4604-83b0-aacfa453b7a2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:55.081968 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e033e1fa-dd77-4604-83b0-aacfa453b7a2 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1724 microversion: 2.20 time: 0.152726 Jul 20 11:48:55.082515 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 606/1200] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:48:54 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:48:56.099867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2d4cdc7c-961a-4042-81a4-fa4316316191 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:56.100922 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2d4cdc7c-961a-4042-81a4-fa4316316191 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:56.109980 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-d3a55c12-ec44-438a-b5d9-ab6a6e9be497 req-d7bee229-b79c-4eb6-952e-ea225dbf8466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38ac977-daa5-4751-a9e8-12c27706032e", "name": "network-vif-deleted", "tag": "98fc8e3d-93c5-45a0-9829-77da42ba8ac3"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:48:56.112382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d4cdc7c-961a-4042-81a4-fa4316316191 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:56.112382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d4cdc7c-961a-4042-81a4-fa4316316191 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:56.112382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d4cdc7c-961a-4042-81a4-fa4316316191 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:56.112382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2d4cdc7c-961a-4042-81a4-fa4316316191 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:56.118828 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d3a55c12-ec44-438a-b5d9-ab6a6e9be497 req-d7bee229-b79c-4eb6-952e-ea225dbf8466 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:56.119271 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-d3a55c12-ec44-438a-b5d9-ab6a6e9be497 req-d7bee229-b79c-4eb6-952e-ea225dbf8466 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:56.130613 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-d3a55c12-ec44-438a-b5d9-ab6a6e9be497 req-d7bee229-b79c-4eb6-952e-ea225dbf8466 service nova] Creating event network-vif-deleted:98fc8e3d-93c5-45a0-9829-77da42ba8ac3 for instance e38ac977-daa5-4751-a9e8-12c27706032e on hv-cinder-82282 Jul 20 11:48:56.136428 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-d3a55c12-ec44-438a-b5d9-ab6a6e9be497 req-d7bee229-b79c-4eb6-952e-ea225dbf8466 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030067 Jul 20 11:48:56.137387 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 607/1201] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:48:56.182590 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d4cdc7c-961a-4042-81a4-fa4316316191 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:56.195315 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d4cdc7c-961a-4042-81a4-fa4316316191 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:56.200408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2d4cdc7c-961a-4042-81a4-fa4316316191 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:56.202824 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2d4cdc7c-961a-4042-81a4-fa4316316191 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1656 microversion: 2.20 time: 0.106775 Jul 20 11:48:56.203883 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 595/1202] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:48:56 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1656 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:48:57.222956 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5d39ce71-e747-4547-bed0-312f35d351d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:57.223678 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5d39ce71-e747-4547-bed0-312f35d351d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:57.229835 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d39ce71-e747-4547-bed0-312f35d351d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:57.230270 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d39ce71-e747-4547-bed0-312f35d351d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:57.231024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d39ce71-e747-4547-bed0-312f35d351d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:57.231449 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d39ce71-e747-4547-bed0-312f35d351d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:57.261480 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d39ce71-e747-4547-bed0-312f35d351d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:57.261922 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5d39ce71-e747-4547-bed0-312f35d351d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:57.262432 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-5d39ce71-e747-4547-bed0-312f35d351d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lazy-loading 'fault' on Instance uuid e38ac977-daa5-4751-a9e8-12c27706032e {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:48:57.305329 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5d39ce71-e747-4547-bed0-312f35d351d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:57.313784 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5d39ce71-e747-4547-bed0-312f35d351d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:57.315386 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5d39ce71-e747-4547-bed0-312f35d351d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:57.316438 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5d39ce71-e747-4547-bed0-312f35d351d9 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1371 microversion: 2.20 time: 0.098298 Jul 20 11:48:57.317031 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 608/1203] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:48:57 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:48:58.335195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f6ac34c0-daa0-4113-a7c9-93805d1da18e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:58.335809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f6ac34c0-daa0-4113-a7c9-93805d1da18e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:58.342769 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6ac34c0-daa0-4113-a7c9-93805d1da18e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:58.343210 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6ac34c0-daa0-4113-a7c9-93805d1da18e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:58.343961 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6ac34c0-daa0-4113-a7c9-93805d1da18e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:58.344388 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6ac34c0-daa0-4113-a7c9-93805d1da18e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:58.374534 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6ac34c0-daa0-4113-a7c9-93805d1da18e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:58.374970 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6ac34c0-daa0-4113-a7c9-93805d1da18e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:58.381048 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-f6ac34c0-daa0-4113-a7c9-93805d1da18e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lazy-loading 'fault' on Instance uuid e38ac977-daa5-4751-a9e8-12c27706032e {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:48:58.415668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6ac34c0-daa0-4113-a7c9-93805d1da18e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:58.423693 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6ac34c0-daa0-4113-a7c9-93805d1da18e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:58.425213 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6ac34c0-daa0-4113-a7c9-93805d1da18e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:58.426357 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f6ac34c0-daa0-4113-a7c9-93805d1da18e tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1371 microversion: 2.20 time: 0.095095 Jul 20 11:48:58.426904 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 596/1204] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:48:58 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:48:59.444890 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-482781d4-2ed9-4c7a-9e14-8143008f4c64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:48:59.445558 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-482781d4-2ed9-4c7a-9e14-8143008f4c64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:48:59.452062 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-482781d4-2ed9-4c7a-9e14-8143008f4c64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:59.452507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-482781d4-2ed9-4c7a-9e14-8143008f4c64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:59.453298 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-482781d4-2ed9-4c7a-9e14-8143008f4c64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:59.453739 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-482781d4-2ed9-4c7a-9e14-8143008f4c64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:59.484760 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-482781d4-2ed9-4c7a-9e14-8143008f4c64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:48:59.485239 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-482781d4-2ed9-4c7a-9e14-8143008f4c64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:48:59.485697 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-482781d4-2ed9-4c7a-9e14-8143008f4c64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lazy-loading 'fault' on Instance uuid e38ac977-daa5-4751-a9e8-12c27706032e {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:48:59.526000 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-482781d4-2ed9-4c7a-9e14-8143008f4c64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:59.534024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-482781d4-2ed9-4c7a-9e14-8143008f4c64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:59.535524 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-482781d4-2ed9-4c7a-9e14-8143008f4c64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:48:59.536671 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-482781d4-2ed9-4c7a-9e14-8143008f4c64 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1371 microversion: 2.20 time: 0.095709 Jul 20 11:48:59.537255 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 609/1205] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:48:59 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:49:00.554743 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b5c5bc1d-1729-428d-85fa-6315bf071d93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:00.555326 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b5c5bc1d-1729-428d-85fa-6315bf071d93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:00.562769 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc1d-1729-428d-85fa-6315bf071d93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:00.563211 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc1d-1729-428d-85fa-6315bf071d93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:00.564089 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc1d-1729-428d-85fa-6315bf071d93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:00.564516 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc1d-1729-428d-85fa-6315bf071d93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:00.596366 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc1d-1729-428d-85fa-6315bf071d93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:00.596958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b5c5bc1d-1729-428d-85fa-6315bf071d93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:00.597523 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-b5c5bc1d-1729-428d-85fa-6315bf071d93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lazy-loading 'fault' on Instance uuid e38ac977-daa5-4751-a9e8-12c27706032e {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:49:00.639209 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5c5bc1d-1729-428d-85fa-6315bf071d93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:00.647262 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5c5bc1d-1729-428d-85fa-6315bf071d93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:00.648901 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b5c5bc1d-1729-428d-85fa-6315bf071d93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63bd59ed8f4e4ae28253a9884b727c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ce8b9ff3945ebbbf933d072515d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:00.650317 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b5c5bc1d-1729-428d-85fa-6315bf071d93 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 200 len: 1371 microversion: 2.20 time: 0.099787 Jul 20 11:49:00.650872 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 597/1206] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:49:00 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:49:01.668687 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c4a5105-fa23-4c7c-b645-d3d4790c3a04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:01.669331 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8c4a5105-fa23-4c7c-b645-d3d4790c3a04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:01.675839 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c4a5105-fa23-4c7c-b645-d3d4790c3a04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:01.676284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c4a5105-fa23-4c7c-b645-d3d4790c3a04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:01.677076 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c4a5105-fa23-4c7c-b645-d3d4790c3a04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:01.677520 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8c4a5105-fa23-4c7c-b645-d3d4790c3a04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:01.690710 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-8c4a5105-fa23-4c7c-b645-d3d4790c3a04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] HTTP exception thrown: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c4a5105-fa23-4c7c-b645-d3d4790c3a04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Request method failure captured: Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e HTTP/1.1 Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-kS_vQtVu4snaDxMvygE0HlZPgOjAfKo4_fKXDnjjNWCDlymm9GFZqwbqnT2vcqIhfluadG17SISxptrQL_g4bHJj5wd1WOEVP_uIvRiiuF8jgL1DAcAbHX0D2Hz4A4GiIIgA1IQDS1QQHQ6AR1IW8imZsZdyZUT80V9FJFuvWEqIY Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: a18ce8b9ff3945ebbbf933d072515d53 Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:49:01.692377 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:49:01.694252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a18ce8b9ff3945ebbbf933d072515d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a18ce8b9ff3945ebbbf933d072515d53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a18ce8b9ff3945ebbbf933d072515d53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a18ce8b9ff3945ebbbf933d072515d53"}]}] Jul 20 11:49:01.694252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:01.694252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: a18ce8b9ff3945ebbbf933d072515d53 Jul 20 11:49:01.694252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:01.694252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeShelveTestJSON-606311989-project Jul 20 11:49:01.694252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:49:01.694252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:49:01.694252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 63bd59ed8f4e4ae28253a9884b727c98 Jul 20 11:49:01.694252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeShelveTestJSON-606311989-project Jul 20 11:49:01.694252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:49:01.694252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:01.694252 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'e38ac977-daa5-4751-a9e8-12c27706032e'} Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:49:01.695240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:01.697439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:01.698999 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8c4a5105-fa23-4c7c-b645-d3d4790c3a04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Returning 404 to user: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:49:01.698999 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8c4a5105-fa23-4c7c-b645-d3d4790c3a04 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 404 len: 111 microversion: 2.20 time: 0.029642 Jul 20 11:49:01.698999 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 610/1207] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:49:01 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:49:01.703260 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2e47a9df-f549-442d-920e-221cb2d03586 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '.version_select at 0x7f44e00fcb80>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:01.807015 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2e47a9df-f549-442d-920e-221cb2d03586 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701889358" status: 204 len: 0 microversion: 2.20 time: 0.107399 Jul 20 11:49:01.807523 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 598/1208] 10.222.0.43 () {60 vars in 1261 bytes} [Wed Jul 20 11:49:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701889358 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:49:04.320260 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-14bcf8f9-20e8-4342-8d36-07d66d62a4eb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:04.320827 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-14bcf8f9-20e8-4342-8d36-07d66d62a4eb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:04.327672 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14bcf8f9-20e8-4342-8d36-07d66d62a4eb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:04.328114 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14bcf8f9-20e8-4342-8d36-07d66d62a4eb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:04.328912 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14bcf8f9-20e8-4342-8d36-07d66d62a4eb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:04.329461 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-14bcf8f9-20e8-4342-8d36-07d66d62a4eb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:04.343429 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-14bcf8f9-20e8-4342-8d36-07d66d62a4eb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] HTTP exception thrown: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-14bcf8f9-20e8-4342-8d36-07d66d62a4eb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Request method failure captured: Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e HTTP/1.1 Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-kS_vQtVu4snaDxMvygE0HlZPgOjAfKo4_fKXDnjjNWCDlymm9GFZqwbqnT2vcqIhfluadG17SISxptrQL_g4bHJj5wd1WOEVP_uIvRiiuF8jgL1DAcAbHX0D2Hz4A4GiIIgA1IQDS1QQHQ6AR1IW8imZsZdyZUT80V9FJFuvWEqIY Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: a18ce8b9ff3945ebbbf933d072515d53 Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:49:04.345003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:49:04.346695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a18ce8b9ff3945ebbbf933d072515d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a18ce8b9ff3945ebbbf933d072515d53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a18ce8b9ff3945ebbbf933d072515d53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a18ce8b9ff3945ebbbf933d072515d53"}]}] Jul 20 11:49:04.346695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:04.346695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: a18ce8b9ff3945ebbbf933d072515d53 Jul 20 11:49:04.346695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:04.346695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeShelveTestJSON-606311989-project Jul 20 11:49:04.346695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:49:04.346695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:49:04.346695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 63bd59ed8f4e4ae28253a9884b727c98 Jul 20 11:49:04.346695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeShelveTestJSON-606311989-project Jul 20 11:49:04.346695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:49:04.346695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:04.346695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'e38ac977-daa5-4751-a9e8-12c27706032e'} Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:49:04.350596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:04.352234 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:04.354534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-14bcf8f9-20e8-4342-8d36-07d66d62a4eb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Returning 404 to user: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:49:04.354534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-14bcf8f9-20e8-4342-8d36-07d66d62a4eb tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 404 len: 111 microversion: 2.20 time: 0.030448 Jul 20 11:49:04.354534 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 611/1209] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jul 20 11:49:04 2022] DELETE /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:49:04.359673 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3c2433e8-4377-4111-ab08-a0dd7ab6b544 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:04.360294 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3c2433e8-4377-4111-ab08-a0dd7ab6b544 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: e38ac977-daa5-4751-a9e8-12c27706032e] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:04.369438 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c2433e8-4377-4111-ab08-a0dd7ab6b544 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:04.369877 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c2433e8-4377-4111-ab08-a0dd7ab6b544 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:04.376737 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c2433e8-4377-4111-ab08-a0dd7ab6b544 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:04.376737 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3c2433e8-4377-4111-ab08-a0dd7ab6b544 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:04.384445 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-3c2433e8-4377-4111-ab08-a0dd7ab6b544 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] HTTP exception thrown: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3c2433e8-4377-4111-ab08-a0dd7ab6b544 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Request method failure captured: Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e HTTP/1.1 Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-kS_vQtVu4snaDxMvygE0HlZPgOjAfKo4_fKXDnjjNWCDlymm9GFZqwbqnT2vcqIhfluadG17SISxptrQL_g4bHJj5wd1WOEVP_uIvRiiuF8jgL1DAcAbHX0D2Hz4A4GiIIgA1IQDS1QQHQ6AR1IW8imZsZdyZUT80V9FJFuvWEqIY Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: a18ce8b9ff3945ebbbf933d072515d53 Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:49:04.386132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:49:04.387902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a18ce8b9ff3945ebbbf933d072515d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a18ce8b9ff3945ebbbf933d072515d53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a18ce8b9ff3945ebbbf933d072515d53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a18ce8b9ff3945ebbbf933d072515d53"}]}] Jul 20 11:49:04.387902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:04.387902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: a18ce8b9ff3945ebbbf933d072515d53 Jul 20 11:49:04.387902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:04.387902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeShelveTestJSON-606311989-project Jul 20 11:49:04.387902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:49:04.387902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:49:04.387902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 63bd59ed8f4e4ae28253a9884b727c98 Jul 20 11:49:04.387902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeShelveTestJSON-606311989-project Jul 20 11:49:04.387902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:49:04.387902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:04.387902 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'e38ac977-daa5-4751-a9e8-12c27706032e'} Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:49:04.388897 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. Jul 20 11:49:04.390479 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:49:04.392016 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3c2433e8-4377-4111-ab08-a0dd7ab6b544 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Returning 404 to user: Instance e38ac977-daa5-4751-a9e8-12c27706032e could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:49:04.392016 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3c2433e8-4377-4111-ab08-a0dd7ab6b544 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e" status: 404 len: 111 microversion: 2.20 time: 0.031640 Jul 20 11:49:04.392016 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 599/1210] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:49:04 2022] GET /compute/v2.1/servers/e38ac977-daa5-4751-a9e8-12c27706032e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:49:15.043940 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be167931-8cfc-421e-b603-022be731752d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:15.044438 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-be167931-8cfc-421e-b603-022be731752d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:15.046624 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:49:15.047299 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:49:15.052079 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be167931-8cfc-421e-b603-022be731752d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:15.052532 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be167931-8cfc-421e-b603-022be731752d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:15.053335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be167931-8cfc-421e-b603-022be731752d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:15.053779 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-be167931-8cfc-421e-b603-022be731752d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:15.069424 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-be167931-8cfc-421e-b603-022be731752d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] HTTP exception thrown: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be167931-8cfc-421e-b603-022be731752d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Request method failure captured: Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c HTTP/1.1 Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-kS_vQtVu4snaDxMvygE0HlZPgOjAfKo4_fKXDnjjNWCDlymm9GFZqwbqnT2vcqIhfluadG17SISxptrQL_g4bHJj5wd1WOEVP_uIvRiiuF8jgL1DAcAbHX0D2Hz4A4GiIIgA1IQDS1QQHQ6AR1IW8imZsZdyZUT80V9FJFuvWEqIY Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: a18ce8b9ff3945ebbbf933d072515d53 Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:49:15.071202 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:49:15.073233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a18ce8b9ff3945ebbbf933d072515d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a18ce8b9ff3945ebbbf933d072515d53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a18ce8b9ff3945ebbbf933d072515d53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a18ce8b9ff3945ebbbf933d072515d53"}]}] Jul 20 11:49:15.073233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:15.073233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: a18ce8b9ff3945ebbbf933d072515d53 Jul 20 11:49:15.073233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:15.073233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeShelveTestJSON-606311989-project Jul 20 11:49:15.073233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:49:15.073233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:49:15.073233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 63bd59ed8f4e4ae28253a9884b727c98 Jul 20 11:49:15.073233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeShelveTestJSON-606311989-project Jul 20 11:49:15.073233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:49:15.073233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:49:15.073233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'ea3abfd3-22be-4728-9006-19ad38c1bd9c'} Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:49:15.074115 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:49:15.076259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:49:15.078508 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-be167931-8cfc-421e-b603-022be731752d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Returning 404 to user: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:49:15.078508 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-be167931-8cfc-421e-b603-022be731752d tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 404 len: 111 microversion: 2.20 time: 0.033534 Jul 20 11:49:15.078508 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 612/1211] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jul 20 11:49:15 2022] DELETE /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:49:15.083172 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-626c0312-b068-4c32-8121-681919217168 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:15.084066 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-626c0312-b068-4c32-8121-681919217168 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] [instance: ea3abfd3-22be-4728-9006-19ad38c1bd9c] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:15.086095 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:49:15.086801 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=48 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:49:15.091842 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-626c0312-b068-4c32-8121-681919217168 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:15.095557 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-626c0312-b068-4c32-8121-681919217168 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:15.095557 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-626c0312-b068-4c32-8121-681919217168 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:15.095557 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-626c0312-b068-4c32-8121-681919217168 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:15.107604 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-626c0312-b068-4c32-8121-681919217168 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] HTTP exception thrown: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-626c0312-b068-4c32-8121-681919217168 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Request method failure captured: Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c HTTP/1.1 Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-kS_vQtVu4snaDxMvygE0HlZPgOjAfKo4_fKXDnjjNWCDlymm9GFZqwbqnT2vcqIhfluadG17SISxptrQL_g4bHJj5wd1WOEVP_uIvRiiuF8jgL1DAcAbHX0D2Hz4A4GiIIgA1IQDS1QQHQ6AR1IW8imZsZdyZUT80V9FJFuvWEqIY Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: a18ce8b9ff3945ebbbf933d072515d53 Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:49:15.109203 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:49:15.113245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a18ce8b9ff3945ebbbf933d072515d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a18ce8b9ff3945ebbbf933d072515d53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a18ce8b9ff3945ebbbf933d072515d53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a18ce8b9ff3945ebbbf933d072515d53"}]}] Jul 20 11:49:15.113245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:15.113245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: a18ce8b9ff3945ebbbf933d072515d53 Jul 20 11:49:15.113245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-606311989 Jul 20 11:49:15.113245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeShelveTestJSON-606311989-project Jul 20 11:49:15.113245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:49:15.113245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:49:15.113245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 63bd59ed8f4e4ae28253a9884b727c98 Jul 20 11:49:15.113245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeShelveTestJSON-606311989-project Jul 20 11:49:15.113245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:49:15.113245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:49:15.113245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'ea3abfd3-22be-4728-9006-19ad38c1bd9c'} Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:49:15.115044 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. Jul 20 11:49:15.122800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:49:15.127828 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-626c0312-b068-4c32-8121-681919217168 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] Returning 404 to user: Instance ea3abfd3-22be-4728-9006-19ad38c1bd9c could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:49:15.127828 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-626c0312-b068-4c32-8121-681919217168 tempest-AttachVolumeShelveTestJSON-606311989 tempest-AttachVolumeShelveTestJSON-606311989-project] 10.222.0.43 "GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c" status: 404 len: 111 microversion: 2.20 time: 0.032267 Jul 20 11:49:15.127828 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 600/1212] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 11:49:15 2022] GET /compute/v2.1/servers/ea3abfd3-22be-4728-9006-19ad38c1bd9c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:49:15.996556 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1486467061", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-443586517", "security_groups": [{"name": "tempest-secgroup-smoke-1035915013"}], "block_device_mapping_v2": [{"uuid": "c0caa058-6b68-4d27-a604-a1eb5d1ffe29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6728c8a5-492f-4e81-8d8b-b2abdb951298"}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:49:16.121820 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] validate_networks() for [('6728c8a5-492f-4e81-8d8b-b2abdb951298', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:49:16.885162 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:49:16.885608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:49:16.886078 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:49:16.886483 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:49:16.886891 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:49:16.896076 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:16.896670 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:16.897590 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:16.898123 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:16.915067 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Getting quotas for project fb6890ad12fa47eeb3cc29dbec41dbe2. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:49:16.921585 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Getting quotas for user a32c5062f269416d9345c2ea2c6f85b6 and project fb6890ad12fa47eeb3cc29dbec41dbe2. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:49:16.998937 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:49:17.003566 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0caa058-6b68-4d27-a604-a1eb5d1ffe29',volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:49:17.497665 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3c912c1b-e65d-435e-a038-45d8c84945e2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.505906 Jul 20 11:49:17.503437 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 613/1213] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:49:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:49:17.520936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a3bcddc5-c163-4dd3-90df-41c50f54afea tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:17.524019 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a3bcddc5-c163-4dd3-90df-41c50f54afea tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:17.606359 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a3bcddc5-c163-4dd3-90df-41c50f54afea tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:17.615421 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a3bcddc5-c163-4dd3-90df-41c50f54afea tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1094 microversion: 2.1 time: 0.105295 Jul 20 11:49:17.616718 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 601/1214] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:17 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1094 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:49:18.636251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-2e5644d9-0dad-4c8c-8083-87ff58fcaab4 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:18.636835 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-2e5644d9-0dad-4c8c-8083-87ff58fcaab4 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:18.643468 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e5644d9-0dad-4c8c-8083-87ff58fcaab4 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:18.649860 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e5644d9-0dad-4c8c-8083-87ff58fcaab4 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:18.649860 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e5644d9-0dad-4c8c-8083-87ff58fcaab4 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:18.649860 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-2e5644d9-0dad-4c8c-8083-87ff58fcaab4 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:18.737849 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-2e5644d9-0dad-4c8c-8083-87ff58fcaab4 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:18.746296 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-2e5644d9-0dad-4c8c-8083-87ff58fcaab4 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1144 microversion: 2.1 time: 0.115771 Jul 20 11:49:18.746878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 614/1215] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:18 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1144 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:19.764659 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-247451e0-02d5-409f-a5bc-bc7cc0df591f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:19.765190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-247451e0-02d5-409f-a5bc-bc7cc0df591f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:19.772700 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-247451e0-02d5-409f-a5bc-bc7cc0df591f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:19.773154 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-247451e0-02d5-409f-a5bc-bc7cc0df591f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:19.774710 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-247451e0-02d5-409f-a5bc-bc7cc0df591f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:19.775151 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-247451e0-02d5-409f-a5bc-bc7cc0df591f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:19.843240 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-247451e0-02d5-409f-a5bc-bc7cc0df591f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:19.850770 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-247451e0-02d5-409f-a5bc-bc7cc0df591f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1192 microversion: 2.1 time: 0.091353 Jul 20 11:49:19.855260 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 602/1216] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:19 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:20.872412 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-ed041333-4bd3-411e-8d8e-32991d4ce176 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:20.873232 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-ed041333-4bd3-411e-8d8e-32991d4ce176 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:20.880836 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed041333-4bd3-411e-8d8e-32991d4ce176 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:20.881053 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed041333-4bd3-411e-8d8e-32991d4ce176 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:20.881732 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed041333-4bd3-411e-8d8e-32991d4ce176 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:20.882244 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-ed041333-4bd3-411e-8d8e-32991d4ce176 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:20.950417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-ed041333-4bd3-411e-8d8e-32991d4ce176 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:20.958796 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-ed041333-4bd3-411e-8d8e-32991d4ce176 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1210 microversion: 2.1 time: 0.090947 Jul 20 11:49:20.959370 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 615/1217] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:20 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:21.975351 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3e2d8e5f-83dc-408a-b50e-60b5a8e7d6d3 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:21.976052 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3e2d8e5f-83dc-408a-b50e-60b5a8e7d6d3 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:21.983095 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e2d8e5f-83dc-408a-b50e-60b5a8e7d6d3 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:21.983906 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e2d8e5f-83dc-408a-b50e-60b5a8e7d6d3 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:21.984976 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e2d8e5f-83dc-408a-b50e-60b5a8e7d6d3 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:21.985642 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3e2d8e5f-83dc-408a-b50e-60b5a8e7d6d3 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:22.145734 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3e2d8e5f-83dc-408a-b50e-60b5a8e7d6d3 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:22.157230 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3e2d8e5f-83dc-408a-b50e-60b5a8e7d6d3 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1278 microversion: 2.1 time: 0.185242 Jul 20 11:49:22.170261 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 603/1218] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:21 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:22.732102 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-95143833-f60c-48bb-9aed-3b43216d0697 req-d7f2ee94-394a-48ff-88af-435dbcd9268f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50770e2b-c996-4781-8e9c-e8c732192d8f", "tag": "b54a0b8c-6f79-4235-a36e-80508962e271"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:49:22.750156 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-95143833-f60c-48bb-9aed-3b43216d0697 req-d7f2ee94-394a-48ff-88af-435dbcd9268f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:22.750606 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-95143833-f60c-48bb-9aed-3b43216d0697 req-d7f2ee94-394a-48ff-88af-435dbcd9268f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:22.762854 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-95143833-f60c-48bb-9aed-3b43216d0697 req-d7f2ee94-394a-48ff-88af-435dbcd9268f service nova] Creating event network-changed:b54a0b8c-6f79-4235-a36e-80508962e271 for instance 50770e2b-c996-4781-8e9c-e8c732192d8f on hv-cinder-82282 Jul 20 11:49:22.769104 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-95143833-f60c-48bb-9aed-3b43216d0697 req-d7f2ee94-394a-48ff-88af-435dbcd9268f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041731 Jul 20 11:49:22.769709 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 616/1219] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:49:23.177889 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-772db898-cdc9-4a2d-a4e4-444e9ad2b373 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:23.178492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-772db898-cdc9-4a2d-a4e4-444e9ad2b373 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:23.186160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-772db898-cdc9-4a2d-a4e4-444e9ad2b373 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:23.187159 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-772db898-cdc9-4a2d-a4e4-444e9ad2b373 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:23.188102 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-772db898-cdc9-4a2d-a4e4-444e9ad2b373 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:23.188531 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-772db898-cdc9-4a2d-a4e4-444e9ad2b373 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:23.341105 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-772db898-cdc9-4a2d-a4e4-444e9ad2b373 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:23.348932 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-772db898-cdc9-4a2d-a4e4-444e9ad2b373 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1266 microversion: 2.1 time: 0.175743 Jul 20 11:49:23.349516 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 604/1220] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:23 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:24.367498 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5374cdf0-7916-49e7-8bf0-cd038c19909a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:24.368634 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5374cdf0-7916-49e7-8bf0-cd038c19909a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:24.374675 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5374cdf0-7916-49e7-8bf0-cd038c19909a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:24.375319 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5374cdf0-7916-49e7-8bf0-cd038c19909a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:24.376087 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5374cdf0-7916-49e7-8bf0-cd038c19909a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:24.376520 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5374cdf0-7916-49e7-8bf0-cd038c19909a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:24.512691 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5374cdf0-7916-49e7-8bf0-cd038c19909a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:24.520749 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5374cdf0-7916-49e7-8bf0-cd038c19909a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1266 microversion: 2.1 time: 0.158078 Jul 20 11:49:24.521361 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 617/1221] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:24 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:25.194275 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5ef0e15b-1897-4bd6-9ce4-d11a32985309 tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] Calling method '.version_select at 0x7f44e022edc0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:25.245724 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5ef0e15b-1897-4bd6-9ce4-d11a32985309 tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/8557a77e-2fb7-428e-9025-0300db641e26" status: 200 len: 350 microversion: 2.1 time: 0.055167 Jul 20 11:49:25.246282 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 605/1222] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:49:25 2022] GET /compute/v2.1/os-volumes/8557a77e-2fb7-428e-9025-0300db641e26 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:49:25.538256 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d3716a35-4a0e-4f1b-9f43-858e157a6c2f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:25.538865 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d3716a35-4a0e-4f1b-9f43-858e157a6c2f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:25.545417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3716a35-4a0e-4f1b-9f43-858e157a6c2f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:25.545867 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3716a35-4a0e-4f1b-9f43-858e157a6c2f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:25.546680 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3716a35-4a0e-4f1b-9f43-858e157a6c2f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:25.547116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d3716a35-4a0e-4f1b-9f43-858e157a6c2f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:25.689748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d3716a35-4a0e-4f1b-9f43-858e157a6c2f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:25.698114 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d3716a35-4a0e-4f1b-9f43-858e157a6c2f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1266 microversion: 2.1 time: 0.163636 Jul 20 11:49:25.698681 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 618/1223] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:25 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:49:26.716412 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a93b1f48-b5e6-43bc-9743-d0eb30e83592 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:26.717057 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a93b1f48-b5e6-43bc-9743-d0eb30e83592 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:26.724208 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a93b1f48-b5e6-43bc-9743-d0eb30e83592 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:26.724723 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a93b1f48-b5e6-43bc-9743-d0eb30e83592 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:26.725452 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a93b1f48-b5e6-43bc-9743-d0eb30e83592 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:26.725917 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a93b1f48-b5e6-43bc-9743-d0eb30e83592 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:26.872668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a93b1f48-b5e6-43bc-9743-d0eb30e83592 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:26.880291 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a93b1f48-b5e6-43bc-9743-d0eb30e83592 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1266 microversion: 2.1 time: 0.169330 Jul 20 11:49:26.883702 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 606/1224] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:26 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:27.896376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9c35bf9c-fc30-4f27-9fdb-bf8b7cd58ec0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:27.897022 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9c35bf9c-fc30-4f27-9fdb-bf8b7cd58ec0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:27.900083 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:49:27.900945 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=6 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:49:27.905783 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c35bf9c-fc30-4f27-9fdb-bf8b7cd58ec0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:27.906226 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c35bf9c-fc30-4f27-9fdb-bf8b7cd58ec0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:27.907291 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c35bf9c-fc30-4f27-9fdb-bf8b7cd58ec0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:27.907724 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9c35bf9c-fc30-4f27-9fdb-bf8b7cd58ec0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:28.041271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-88df30a0-ad6e-497d-972e-935cec4eff29 tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] Calling method '.version_select at 0x7f44e38e50d0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:28.050881 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:49:28.060612 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9c35bf9c-fc30-4f27-9fdb-bf8b7cd58ec0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:28.069165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9c35bf9c-fc30-4f27-9fdb-bf8b7cd58ec0 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1266 microversion: 2.1 time: 0.176576 Jul 20 11:49:28.074025 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 619/1225] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:27 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:28.120687 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-88df30a0-ad6e-497d-972e-935cec4eff29 tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/8810ccec-daf4-494e-881a-589fc8feb355" status: 200 len: 351 microversion: 2.1 time: 0.084084 Jul 20 11:49:28.121282 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 607/1226] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:49:28 2022] GET /compute/v2.1/os-volumes/8810ccec-daf4-494e-881a-589fc8feb355 => generated 351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:49:29.092360 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-744c0324-862f-4a68-a387-a3a0e0669120 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:29.093032 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-744c0324-862f-4a68-a387-a3a0e0669120 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:29.100199 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-744c0324-862f-4a68-a387-a3a0e0669120 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:29.100696 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-744c0324-862f-4a68-a387-a3a0e0669120 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:29.101571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-744c0324-862f-4a68-a387-a3a0e0669120 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:29.102118 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-744c0324-862f-4a68-a387-a3a0e0669120 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:29.248089 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-744c0324-862f-4a68-a387-a3a0e0669120 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:29.256079 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-744c0324-862f-4a68-a387-a3a0e0669120 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1266 microversion: 2.1 time: 0.167768 Jul 20 11:49:29.265571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 620/1227] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:29 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:30.274621 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f3fc9d74-3064-46b5-a9c8-34be0c5e0392 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:30.279132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f3fc9d74-3064-46b5-a9c8-34be0c5e0392 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:30.282738 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3fc9d74-3064-46b5-a9c8-34be0c5e0392 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:30.283179 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3fc9d74-3064-46b5-a9c8-34be0c5e0392 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:30.283941 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3fc9d74-3064-46b5-a9c8-34be0c5e0392 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:30.284366 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f3fc9d74-3064-46b5-a9c8-34be0c5e0392 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:30.422636 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f3fc9d74-3064-46b5-a9c8-34be0c5e0392 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:30.430142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f3fc9d74-3064-46b5-a9c8-34be0c5e0392 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1266 microversion: 2.1 time: 0.161026 Jul 20 11:49:30.431399 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 608/1228] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:30 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:30.832608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-820b2609-1467-483a-ab06-eafc66df1fbc tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] Calling method '.version_select at 0x7f44e38d5700>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:30.883150 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-820b2609-1467-483a-ab06-eafc66df1fbc tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/797482f4-6867-4ba2-a846-29f8879c9a5e" status: 200 len: 351 microversion: 2.1 time: 0.054248 Jul 20 11:49:30.890171 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 621/1229] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:49:30 2022] GET /compute/v2.1/os-volumes/797482f4-6867-4ba2-a846-29f8879c9a5e => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:49:30.895632 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a0a62f17-68ba-465d-8616-5ff961387a13 tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] Calling method '.version_select at 0x7f44e022e0d0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:30.976178 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a0a62f17-68ba-465d-8616-5ff961387a13 tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084437 Jul 20 11:49:30.976750 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 609/1230] 10.222.0.43 () {58 vars in 1133 bytes} [Wed Jul 20 11:49:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:30.988711 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-599a88cf-1dc6-4b82-afec-490ceabda45d tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] Calling method '.version_select at 0x7f44e390c5e0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:31.081887 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-599a88cf-1dc6-4b82-afec-490ceabda45d tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.096871 Jul 20 11:49:31.082558 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 622/1231] 10.222.0.43 () {58 vars in 1148 bytes} [Wed Jul 20 11:49:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:49:31.096725 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-15df2b65-ee67-4c84-9015-d0d753f2b469 tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] Calling method '.version_select at 0x7f44e01a1b80>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:31.178150 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-15df2b65-ee67-4c84-9015-d0d753f2b469 tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085536 Jul 20 11:49:31.178745 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 610/1232] 10.222.0.43 () {58 vars in 1133 bytes} [Wed Jul 20 11:49:31 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:31.189932 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-013ca738-407c-49e1-8806-2d9f37b94c4f tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] Calling method '.version_select at 0x7f44e38b13a0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:31.278120 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-013ca738-407c-49e1-8806-2d9f37b94c4f tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091859 Jul 20 11:49:31.278689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 623/1233] 10.222.0.43 () {58 vars in 1166 bytes} [Wed Jul 20 11:49:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:49:31.292193 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6876e5a2-79a5-49f0-852f-f690c0fa56cf tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] Calling method '.version_select at 0x7f44e38e5e50>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:31.379432 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6876e5a2-79a5-49f0-852f-f690c0fa56cf tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089847 Jul 20 11:49:31.379432 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 611/1234] 10.222.0.43 () {58 vars in 1169 bytes} [Wed Jul 20 11:49:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:49:31.390389 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0de5b37d-d97c-4d0b-b7cb-9f3b7a583581 tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] Calling method '.version_select at 0x7f44e03cd280>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:31.447563 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-06c66472-70f3-47dc-9982-9490a5bae123 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:31.448175 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-06c66472-70f3-47dc-9982-9490a5bae123 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:31.454807 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06c66472-70f3-47dc-9982-9490a5bae123 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:31.455489 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06c66472-70f3-47dc-9982-9490a5bae123 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:31.456481 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06c66472-70f3-47dc-9982-9490a5bae123 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:31.456980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-06c66472-70f3-47dc-9982-9490a5bae123 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:31.477926 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0de5b37d-d97c-4d0b-b7cb-9f3b7a583581 tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090411 Jul 20 11:49:31.479500 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 624/1235] 10.222.0.43 () {58 vars in 1154 bytes} [Wed Jul 20 11:49:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:31.490980 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-48c3326c-48b3-408e-9259-706ed1c77072 tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] Calling method '.version_select at 0x7f44e389d940>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:31.595955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-48c3326c-48b3-408e-9259-706ed1c77072 tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.108665 Jul 20 11:49:31.597636 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 625/1236] 10.222.0.43 () {58 vars in 1187 bytes} [Wed Jul 20 11:49:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:49:31.611469 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-21676ad0-c0ca-49f5-b966-5dfbe778b59e tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] Calling method '.version_select at 0x7f44e01d9670>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:31.642586 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-06c66472-70f3-47dc-9982-9490a5bae123 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:31.654814 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-06c66472-70f3-47dc-9982-9490a5bae123 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1266 microversion: 2.1 time: 0.210979 Jul 20 11:49:31.655867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 612/1237] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:31 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:49:31.720536 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-21676ad0-c0ca-49f5-b966-5dfbe778b59e tempest-VolumesTestJSON-1735007386 tempest-VolumesTestJSON-1735007386-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.114345 Jul 20 11:49:31.721454 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 626/1238] 10.222.0.43 () {58 vars in 1154 bytes} [Wed Jul 20 11:49:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:49:32.671757 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-597a6298-3721-4cd7-be59-f63d44325d4f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:32.672465 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-597a6298-3721-4cd7-be59-f63d44325d4f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:32.678945 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-597a6298-3721-4cd7-be59-f63d44325d4f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:32.679389 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-597a6298-3721-4cd7-be59-f63d44325d4f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:32.680242 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-597a6298-3721-4cd7-be59-f63d44325d4f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:32.680689 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-597a6298-3721-4cd7-be59-f63d44325d4f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:32.833998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-597a6298-3721-4cd7-be59-f63d44325d4f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:32.842139 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-597a6298-3721-4cd7-be59-f63d44325d4f tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1266 microversion: 2.1 time: 0.174260 Jul 20 11:49:32.842721 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 613/1239] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:32 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:33.859979 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-81e73954-3e5a-419a-9122-327b759f9c4a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:33.863367 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-81e73954-3e5a-419a-9122-327b759f9c4a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:33.871164 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81e73954-3e5a-419a-9122-327b759f9c4a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:33.871658 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81e73954-3e5a-419a-9122-327b759f9c4a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:33.872439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81e73954-3e5a-419a-9122-327b759f9c4a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:33.872907 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-81e73954-3e5a-419a-9122-327b759f9c4a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:34.009268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-81e73954-3e5a-419a-9122-327b759f9c4a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:34.016923 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-81e73954-3e5a-419a-9122-327b759f9c4a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1266 microversion: 2.1 time: 0.161259 Jul 20 11:49:34.017509 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 627/1240] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:33 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:35.035258 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c52670f7-cf43-4a11-b60a-cc3cfe7bf9d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:35.035876 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c52670f7-cf43-4a11-b60a-cc3cfe7bf9d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:35.043000 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c52670f7-cf43-4a11-b60a-cc3cfe7bf9d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:35.043452 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c52670f7-cf43-4a11-b60a-cc3cfe7bf9d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:35.044291 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c52670f7-cf43-4a11-b60a-cc3cfe7bf9d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:35.044729 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c52670f7-cf43-4a11-b60a-cc3cfe7bf9d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:35.181652 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c52670f7-cf43-4a11-b60a-cc3cfe7bf9d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:35.189368 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c52670f7-cf43-4a11-b60a-cc3cfe7bf9d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1266 microversion: 2.1 time: 0.158259 Jul 20 11:49:35.189952 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 614/1241] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:35 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:35.413464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-8cab9189-2e6f-4541-a2a0-6ca0b825decc req-4c1cbb36-7422-4482-9d7f-4fe0097d9751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50770e2b-c996-4781-8e9c-e8c732192d8f", "name": "network-vif-plugged", "status": "completed", "tag": "b54a0b8c-6f79-4235-a36e-80508962e271"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:49:35.413464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8cab9189-2e6f-4541-a2a0-6ca0b825decc req-4c1cbb36-7422-4482-9d7f-4fe0097d9751 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:35.413464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-8cab9189-2e6f-4541-a2a0-6ca0b825decc req-4c1cbb36-7422-4482-9d7f-4fe0097d9751 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:35.424011 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-8cab9189-2e6f-4541-a2a0-6ca0b825decc req-4c1cbb36-7422-4482-9d7f-4fe0097d9751 service nova] Creating event network-vif-plugged:b54a0b8c-6f79-4235-a36e-80508962e271 for instance 50770e2b-c996-4781-8e9c-e8c732192d8f on hv-cinder-82282 Jul 20 11:49:35.429455 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-8cab9189-2e6f-4541-a2a0-6ca0b825decc req-4c1cbb36-7422-4482-9d7f-4fe0097d9751 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029926 Jul 20 11:49:35.430057 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 628/1242] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:49:36.206245 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-fdcaf48d-e321-4155-b330-0637d2552d13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:36.206939 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-fdcaf48d-e321-4155-b330-0637d2552d13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:36.214010 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdcaf48d-e321-4155-b330-0637d2552d13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:36.214575 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdcaf48d-e321-4155-b330-0637d2552d13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:36.215494 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdcaf48d-e321-4155-b330-0637d2552d13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:36.216400 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-fdcaf48d-e321-4155-b330-0637d2552d13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:36.403063 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-fdcaf48d-e321-4155-b330-0637d2552d13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:36.412615 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-fdcaf48d-e321-4155-b330-0637d2552d13 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1266 microversion: 2.1 time: 0.210354 Jul 20 11:49:36.414201 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 615/1243] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:36 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:37.433603 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9d8fdced-75a6-4f7a-900e-2c9b5b88b78e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:37.434298 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9d8fdced-75a6-4f7a-900e-2c9b5b88b78e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:37.440584 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d8fdced-75a6-4f7a-900e-2c9b5b88b78e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:37.441066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d8fdced-75a6-4f7a-900e-2c9b5b88b78e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:37.441825 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d8fdced-75a6-4f7a-900e-2c9b5b88b78e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:37.442288 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9d8fdced-75a6-4f7a-900e-2c9b5b88b78e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:37.580309 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9d8fdced-75a6-4f7a-900e-2c9b5b88b78e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:37.587039 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9d8fdced-75a6-4f7a-900e-2c9b5b88b78e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1266 microversion: 2.1 time: 0.158902 Jul 20 11:49:37.587623 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 629/1244] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:37 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:38.603653 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-846b9b99-d820-4485-b04e-aed456239c1e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:38.605180 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-846b9b99-d820-4485-b04e-aed456239c1e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:38.612698 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-846b9b99-d820-4485-b04e-aed456239c1e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:38.619648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-846b9b99-d820-4485-b04e-aed456239c1e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:38.619648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-846b9b99-d820-4485-b04e-aed456239c1e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:38.619648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-846b9b99-d820-4485-b04e-aed456239c1e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:38.756405 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-846b9b99-d820-4485-b04e-aed456239c1e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:38.765344 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-846b9b99-d820-4485-b04e-aed456239c1e tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1453 microversion: 2.1 time: 0.165564 Jul 20 11:49:38.765952 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 616/1245] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:38 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:38.785024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b32ee884-acb5-4548-bc0c-b456d2c9bdf2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:49:38.785641 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b32ee884-acb5-4548-bc0c-b456d2c9bdf2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:49:38.795559 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b32ee884-acb5-4548-bc0c-b456d2c9bdf2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:38.795559 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b32ee884-acb5-4548-bc0c-b456d2c9bdf2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:38.795559 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b32ee884-acb5-4548-bc0c-b456d2c9bdf2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:38.795892 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b32ee884-acb5-4548-bc0c-b456d2c9bdf2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:38.946637 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b32ee884-acb5-4548-bc0c-b456d2c9bdf2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:49:38.954212 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b32ee884-acb5-4548-bc0c-b456d2c9bdf2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1453 microversion: 2.1 time: 0.174351 Jul 20 11:49:38.954786 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 630/1246] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:49:38 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1453 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:49:41.530626 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-8e659983-d357-4fda-94aa-9208d6b01dde req-74adb80c-8ed1-44cc-bd2d-8ac528de5f3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50770e2b-c996-4781-8e9c-e8c732192d8f", "tag": "b54a0b8c-6f79-4235-a36e-80508962e271"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:49:41.540029 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-8e659983-d357-4fda-94aa-9208d6b01dde req-74adb80c-8ed1-44cc-bd2d-8ac528de5f3f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:49:41.540722 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-8e659983-d357-4fda-94aa-9208d6b01dde req-74adb80c-8ed1-44cc-bd2d-8ac528de5f3f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:49:41.554004 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-8e659983-d357-4fda-94aa-9208d6b01dde req-74adb80c-8ed1-44cc-bd2d-8ac528de5f3f service nova] Creating event network-changed:b54a0b8c-6f79-4235-a36e-80508962e271 for instance 50770e2b-c996-4781-8e9c-e8c732192d8f on hv-cinder-82282 Jul 20 11:49:41.561829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-8e659983-d357-4fda-94aa-9208d6b01dde req-74adb80c-8ed1-44cc-bd2d-8ac528de5f3f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254287 Jul 20 11:49:41.562884 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 617/1247] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:50:02.011348 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4197b972-6f42-4b5b-88ca-626299a6798f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:02.012383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4197b972-6f42-4b5b-88ca-626299a6798f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:02.014812 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:02.015495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=62 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:02.020248 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4197b972-6f42-4b5b-88ca-626299a6798f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:02.020699 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4197b972-6f42-4b5b-88ca-626299a6798f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:02.021715 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4197b972-6f42-4b5b-88ca-626299a6798f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:02.022179 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4197b972-6f42-4b5b-88ca-626299a6798f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:02.052245 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4197b972-6f42-4b5b-88ca-626299a6798f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044964 Jul 20 11:50:02.053040 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 631/1248] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:50:02 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:50:02.112007 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-666d313f-df36-4b94-971b-bd48eedbb3a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:02.113187 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-666d313f-df36-4b94-971b-bd48eedbb3a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:02.116160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=28 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:02.116837 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=64 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:02.122282 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-666d313f-df36-4b94-971b-bd48eedbb3a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:02.122733 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-666d313f-df36-4b94-971b-bd48eedbb3a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:02.123509 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-666d313f-df36-4b94-971b-bd48eedbb3a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:02.123935 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-666d313f-df36-4b94-971b-bd48eedbb3a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:02.154812 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-666d313f-df36-4b94-971b-bd48eedbb3a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:50:02.504563 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-666d313f-df36-4b94-971b-bd48eedbb3a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 204 len: 0 microversion: 2.1 time: 0.396552 Jul 20 11:50:02.505369 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 618/1249] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:50:02 2022] DELETE /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:50:02.516970 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b9de4c8d-39fc-4e2c-95f8-7910343b29fa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:02.518002 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b9de4c8d-39fc-4e2c-95f8-7910343b29fa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:02.529735 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9de4c8d-39fc-4e2c-95f8-7910343b29fa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:02.531750 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9de4c8d-39fc-4e2c-95f8-7910343b29fa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:02.531750 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9de4c8d-39fc-4e2c-95f8-7910343b29fa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:02.532244 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b9de4c8d-39fc-4e2c-95f8-7910343b29fa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:02.677747 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b9de4c8d-39fc-4e2c-95f8-7910343b29fa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:02.686032 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b9de4c8d-39fc-4e2c-95f8-7910343b29fa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1671 microversion: 2.1 time: 0.175479 Jul 20 11:50:02.686590 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 632/1250] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:02 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1671 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:03.704128 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-838381e8-fc9e-4d87-a421-6beaeba91edc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:03.704858 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-838381e8-fc9e-4d87-a421-6beaeba91edc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:03.712395 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-838381e8-fc9e-4d87-a421-6beaeba91edc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:03.712865 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-838381e8-fc9e-4d87-a421-6beaeba91edc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:03.713650 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-838381e8-fc9e-4d87-a421-6beaeba91edc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:03.714119 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-838381e8-fc9e-4d87-a421-6beaeba91edc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:03.930547 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-838381e8-fc9e-4d87-a421-6beaeba91edc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:03.940696 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-838381e8-fc9e-4d87-a421-6beaeba91edc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1671 microversion: 2.1 time: 0.240697 Jul 20 11:50:03.941585 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 619/1251] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:03 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1671 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:04.959175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-31a524ff-210e-4464-a7ca-e7566c0b98ef tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:04.959891 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-31a524ff-210e-4464-a7ca-e7566c0b98ef tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:04.968957 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31a524ff-210e-4464-a7ca-e7566c0b98ef tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:04.969401 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31a524ff-210e-4464-a7ca-e7566c0b98ef tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:04.970174 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31a524ff-210e-4464-a7ca-e7566c0b98ef tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:04.970607 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-31a524ff-210e-4464-a7ca-e7566c0b98ef tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:05.138208 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-31a524ff-210e-4464-a7ca-e7566c0b98ef tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:05.147664 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-31a524ff-210e-4464-a7ca-e7566c0b98ef tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1671 microversion: 2.1 time: 0.192637 Jul 20 11:50:05.149191 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 633/1252] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:04 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1671 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:05.475228 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-c2380758-6c70-4041-beb7-a4c6919ba1c0 req-18a4027f-46a3-4c0c-a4ff-a876f7d1297f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a026878a-994a-4ce9-8c8c-550e0631ef69", "name": "network-vif-deleted", "tag": "a6873909-d245-45e8-9730-87b2e3690590"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:50:05.485618 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c2380758-6c70-4041-beb7-a4c6919ba1c0 req-18a4027f-46a3-4c0c-a4ff-a876f7d1297f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:05.485618 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-c2380758-6c70-4041-beb7-a4c6919ba1c0 req-18a4027f-46a3-4c0c-a4ff-a876f7d1297f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:05.504332 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-c2380758-6c70-4041-beb7-a4c6919ba1c0 req-18a4027f-46a3-4c0c-a4ff-a876f7d1297f service nova] Creating event network-vif-deleted:a6873909-d245-45e8-9730-87b2e3690590 for instance a026878a-994a-4ce9-8c8c-550e0631ef69 on hv-cinder-82282 Jul 20 11:50:05.509801 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-c2380758-6c70-4041-beb7-a4c6919ba1c0 req-18a4027f-46a3-4c0c-a4ff-a876f7d1297f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039892 Jul 20 11:50:05.510411 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 620/1253] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:50:06.165895 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-91817219-4206-49e9-917e-777f3ffdfd56 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:06.166555 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-91817219-4206-49e9-917e-777f3ffdfd56 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:06.173525 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91817219-4206-49e9-917e-777f3ffdfd56 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:06.173996 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91817219-4206-49e9-917e-777f3ffdfd56 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:06.174815 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91817219-4206-49e9-917e-777f3ffdfd56 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:06.175417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-91817219-4206-49e9-917e-777f3ffdfd56 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:06.244141 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-91817219-4206-49e9-917e-777f3ffdfd56 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:06.252014 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-91817219-4206-49e9-917e-777f3ffdfd56 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1604 microversion: 2.1 time: 0.090242 Jul 20 11:50:06.252575 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 634/1254] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:06 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1604 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:50:07.272279 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-da308ec0-866f-4b3c-9aaf-958f636ba58f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:07.272980 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-da308ec0-866f-4b3c-9aaf-958f636ba58f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:07.279147 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da308ec0-866f-4b3c-9aaf-958f636ba58f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:07.279588 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da308ec0-866f-4b3c-9aaf-958f636ba58f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:07.280347 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da308ec0-866f-4b3c-9aaf-958f636ba58f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:07.280774 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-da308ec0-866f-4b3c-9aaf-958f636ba58f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:07.346733 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-da308ec0-866f-4b3c-9aaf-958f636ba58f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:07.354250 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-da308ec0-866f-4b3c-9aaf-958f636ba58f tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1604 microversion: 2.1 time: 0.086759 Jul 20 11:50:07.354825 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 621/1255] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:07 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1604 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:08.371729 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4f3a69b0-2570-40a5-96e1-702be2c30e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:08.372376 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4f3a69b0-2570-40a5-96e1-702be2c30e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:08.378993 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f3a69b0-2570-40a5-96e1-702be2c30e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:08.382449 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f3a69b0-2570-40a5-96e1-702be2c30e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:08.382449 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f3a69b0-2570-40a5-96e1-702be2c30e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:08.382449 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f3a69b0-2570-40a5-96e1-702be2c30e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:08.447736 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4f3a69b0-2570-40a5-96e1-702be2c30e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:08.456073 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4f3a69b0-2570-40a5-96e1-702be2c30e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1604 microversion: 2.1 time: 0.088287 Jul 20 11:50:08.456648 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 635/1256] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:08 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1604 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:09.474212 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-07ba6146-19f8-4e39-b0c5-41ea7c378cd7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:09.474953 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-07ba6146-19f8-4e39-b0c5-41ea7c378cd7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:09.482594 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07ba6146-19f8-4e39-b0c5-41ea7c378cd7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:09.483335 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07ba6146-19f8-4e39-b0c5-41ea7c378cd7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:09.484121 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07ba6146-19f8-4e39-b0c5-41ea7c378cd7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:09.484700 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07ba6146-19f8-4e39-b0c5-41ea7c378cd7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:09.518534 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07ba6146-19f8-4e39-b0c5-41ea7c378cd7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:09.519315 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07ba6146-19f8-4e39-b0c5-41ea7c378cd7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:09.520095 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-07ba6146-19f8-4e39-b0c5-41ea7c378cd7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lazy-loading 'fault' on Instance uuid a026878a-994a-4ce9-8c8c-550e0631ef69 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:50:09.566974 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-07ba6146-19f8-4e39-b0c5-41ea7c378cd7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:09.575424 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-07ba6146-19f8-4e39-b0c5-41ea7c378cd7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 200 len: 1327 microversion: 2.1 time: 0.105027 Jul 20 11:50:09.583563 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 622/1257] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:09 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:10.593044 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-503584470", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "networks": [{"uuid": "b4db7f72-f7af-4d02-bbbf-22d232c0d28d"}]}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:50:10.594476 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4d28ac34-f395-4f93-94d2-92b61be5d3fc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:10.595098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-4d28ac34-f395-4f93-94d2-92b61be5d3fc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:10.602893 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d28ac34-f395-4f93-94d2-92b61be5d3fc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:10.603460 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d28ac34-f395-4f93-94d2-92b61be5d3fc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:10.604158 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d28ac34-f395-4f93-94d2-92b61be5d3fc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:10.604586 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-4d28ac34-f395-4f93-94d2-92b61be5d3fc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:10.625553 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-4d28ac34-f395-4f93-94d2-92b61be5d3fc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] HTTP exception thrown: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4d28ac34-f395-4f93-94d2-92b61be5d3fc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Request method failure captured: Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 HTTP/1.1 Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-qaHs9ytbd3SDhbSUdhK9F76xxklEv1QTm_5pby9z9PixG8gtwZyB8qkx_58-MYxgiimAGs_UJoTa3jTXBk6dfObJ3QVZq37dNVY8v0VRoQbbFkO5rsWlCM5g0i7LEEglQvoY31DfpuxLDcPsLPVZL-uqFMI9llEz6BgMRKcyftrRQ Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: 0eb934ac079d4a428bea92620e05280f Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:50:10.627467 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:50:10.629162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0eb934ac079d4a428bea92620e05280f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0eb934ac079d4a428bea92620e05280f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0eb934ac079d4a428bea92620e05280f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0eb934ac079d4a428bea92620e05280f"}]}] Jul 20 11:50:10.629162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:50:10.629162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 0eb934ac079d4a428bea92620e05280f Jul 20 11:50:10.629162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:50:10.629162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeTestJSON-1988218754-project Jul 20 11:50:10.629162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:50:10.629162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:50:10.629162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 961ac5eb91a2432d971f4622620e4e1c Jul 20 11:50:10.629162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeTestJSON-1988218754-project Jul 20 11:50:10.629162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:50:10.629162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:50:10.629162 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'a026878a-994a-4ce9-8c8c-550e0631ef69'} Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:50:10.630069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:50:10.631552 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:50:10.643144 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-4d28ac34-f395-4f93-94d2-92b61be5d3fc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Returning 404 to user: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:50:10.643144 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-4d28ac34-f395-4f93-94d2-92b61be5d3fc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 404 len: 111 microversion: 2.1 time: 0.038953 Jul 20 11:50:10.643144 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 623/1258] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:10 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:50:10.647359 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] validate_networks() for [('b4db7f72-f7af-4d02-bbbf-22d232c0d28d', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:50:10.651230 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-89e9b484-b889-4d74-9760-337ed791c2de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '.version_select at 0x7f44e01a18b0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:10.744936 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-89e9b484-b889-4d74-9760-337ed791c2de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-224141810" status: 202 len: 0 microversion: 2.1 time: 0.098395 Jul 20 11:50:10.745523 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 624/1259] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jul 20 11:50:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-224141810 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:50:11.022642 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:50:11.022642 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:50:11.022642 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:50:11.022642 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:50:11.022642 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:50:11.035125 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:11.035668 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:11.036529 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:11.037036 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:11.057072 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Getting quotas for project e4cd929e5d1a40bf8073e26456a09684. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:50:11.061165 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Getting quotas for user 2fca61a3bb8145d2aba5cecf37e870c0 and project e4cd929e5d1a40bf8073e26456a09684. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:50:11.073556 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:50:11.075862 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:50:11.231385 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-78f0b497-13b5-4cbf-8d58-d9af00e6cd5a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642394 Jul 20 11:50:11.232738 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 636/1260] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:50:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:50:11.243847 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-18b85ce2-7649-458f-b199-ea75e1a1e3b9 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:11.244593 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-18b85ce2-7649-458f-b199-ea75e1a1e3b9 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:11.507492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-18b85ce2-7649-458f-b199-ea75e1a1e3b9 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:11.516252 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-18b85ce2-7649-458f-b199-ea75e1a1e3b9 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1213 microversion: 2.1 time: 0.276869 Jul 20 11:50:11.516963 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 625/1261] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:11 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1213 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:11.976249 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-77b0c294-e3b3-487b-a1db-325ab84960b2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Action: 'create', calling method: .version_select at 0x7f44e38d58b0>, body: {"keypair": {"name": "tempest-keypair-1773846466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5ZRapZSagV5AiruCDmtcXPRwoMY5IjDLBahE1cnEQn2A/RJDYLyI4DtLeD+xNJ3h7ZMpzhOtQQMb1cJ3tu+Sl+owEtVSzcHX2SeyC+DoMbQDD8W705/3IU3+iSA7NA5Q=="}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:50:11.991533 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-77b0c294-e3b3-487b-a1db-325ab84960b2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Getting quotas for project 0eb934ac079d4a428bea92620e05280f. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:50:11.995497 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-77b0c294-e3b3-487b-a1db-325ab84960b2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Getting quotas for user 961ac5eb91a2432d971f4622620e4e1c and project 0eb934ac079d4a428bea92620e05280f. Resources: {'key_pairs'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:50:12.134792 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-77b0c294-e3b3-487b-a1db-325ab84960b2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163137 Jul 20 11:50:12.136104 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 637/1262] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 11:50:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:50:12.534877 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e4c72b42-5a91-450e-bc56-7df189186aaa tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:12.534877 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e4c72b42-5a91-450e-bc56-7df189186aaa tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:12.590692 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e4c72b42-5a91-450e-bc56-7df189186aaa tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:12.598007 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e4c72b42-5a91-450e-bc56-7df189186aaa tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1213 microversion: 2.1 time: 0.069111 Jul 20 11:50:12.598598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 626/1263] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:12 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:13.618388 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-50ede44e-f2ed-4839-b3cd-8f8f2b2fa1e3 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:13.619233 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-50ede44e-f2ed-4839-b3cd-8f8f2b2fa1e3 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:13.626198 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50ede44e-f2ed-4839-b3cd-8f8f2b2fa1e3 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:13.626638 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50ede44e-f2ed-4839-b3cd-8f8f2b2fa1e3 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:13.627432 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50ede44e-f2ed-4839-b3cd-8f8f2b2fa1e3 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:13.627863 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-50ede44e-f2ed-4839-b3cd-8f8f2b2fa1e3 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:13.718727 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-50ede44e-f2ed-4839-b3cd-8f8f2b2fa1e3 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:13.733856 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-50ede44e-f2ed-4839-b3cd-8f8f2b2fa1e3 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1217 microversion: 2.1 time: 0.120219 Jul 20 11:50:13.737962 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 638/1264] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:13 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:14.751743 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-f6176dd4-2bf4-4f17-a730-29688c7eeeac tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:14.752503 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-f6176dd4-2bf4-4f17-a730-29688c7eeeac tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:14.760261 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6176dd4-2bf4-4f17-a730-29688c7eeeac tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:14.760706 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6176dd4-2bf4-4f17-a730-29688c7eeeac tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:14.761529 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6176dd4-2bf4-4f17-a730-29688c7eeeac tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:14.762070 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-f6176dd4-2bf4-4f17-a730-29688c7eeeac tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:14.833283 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-f6176dd4-2bf4-4f17-a730-29688c7eeeac tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:14.840706 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-f6176dd4-2bf4-4f17-a730-29688c7eeeac tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1217 microversion: 2.1 time: 0.093052 Jul 20 11:50:14.841373 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 627/1265] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:14 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:15.012219 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-258372955", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05811bd0-6102-4834-ad70-2ad3a86bc895"}], "security_groups": [{"name": "tempest-securitygroup--324374984"}], "key_name": "tempest-keypair-1773846466", "user_data": "}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:50:15.120206 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.network.neutron [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] validate_networks() for [('05811bd0-6102-4834-ad70-2ad3a86bc895', None, None, None, None, None)] {{(pid=124831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:50:15.540420 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Flavor limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:50:15.540988 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Image limits 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:50:15.541539 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Flavor pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:50:15.542022 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Image pref 0:0:0 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:50:15.542552 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.virt.hardware [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:50:15.552261 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:15.552877 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:15.553689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:15.554135 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:15.572364 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Getting quotas for project 0eb934ac079d4a428bea92620e05280f. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:50:15.587301 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.quota [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Getting quotas for user 961ac5eb91a2432d971f4622620e4e1c and project 0eb934ac079d4a428bea92620e05280f. Resources: {'instances', 'ram', 'cores'} {{(pid=124831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:50:15.588960 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Going to run 1 instances... {{(pid=124831) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:50:15.591203 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:50:15.797760 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-40850cc4-3d9d-4550-be34-8499f0f1f129 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.789758 Jul 20 11:50:15.798338 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 639/1266] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:50:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:50:15.809621 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-241252c1-ab5e-4dae-8688-87edd0ec43f7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:15.810231 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-241252c1-ab5e-4dae-8688-87edd0ec43f7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:15.857984 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7d8494ce-7f82-4ab1-bdf3-7470be3d9d46 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:15.858615 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-7d8494ce-7f82-4ab1-bdf3-7470be3d9d46 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:15.870037 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d8494ce-7f82-4ab1-bdf3-7470be3d9d46 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:15.870818 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d8494ce-7f82-4ab1-bdf3-7470be3d9d46 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:15.871928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d8494ce-7f82-4ab1-bdf3-7470be3d9d46 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:15.872600 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-7d8494ce-7f82-4ab1-bdf3-7470be3d9d46 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:15.880081 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-241252c1-ab5e-4dae-8688-87edd0ec43f7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:15.889215 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-241252c1-ab5e-4dae-8688-87edd0ec43f7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1237 microversion: 2.1 time: 0.084481 Jul 20 11:50:15.889802 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 628/1267] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:15 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:15.959380 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-7d8494ce-7f82-4ab1-bdf3-7470be3d9d46 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:15.959380 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7d8494ce-7f82-4ab1-bdf3-7470be3d9d46 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1265 microversion: 2.1 time: 0.100247 Jul 20 11:50:15.959380 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 640/1268] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:15 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:50:16.907622 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-e8e51cc2-0f16-4fc3-a0bb-cf0a17deef52 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:16.907622 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-e8e51cc2-0f16-4fc3-a0bb-cf0a17deef52 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:16.972306 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-073b051b-9d8d-4943-badd-a24231a71955 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:16.973602 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-073b051b-9d8d-4943-badd-a24231a71955 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:16.978691 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-e8e51cc2-0f16-4fc3-a0bb-cf0a17deef52 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:16.981406 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-073b051b-9d8d-4943-badd-a24231a71955 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:16.982199 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-073b051b-9d8d-4943-badd-a24231a71955 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:16.983198 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-073b051b-9d8d-4943-badd-a24231a71955 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:16.983699 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-073b051b-9d8d-4943-badd-a24231a71955 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:16.987451 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-e8e51cc2-0f16-4fc3-a0bb-cf0a17deef52 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1237 microversion: 2.1 time: 0.083989 Jul 20 11:50:16.992984 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 629/1269] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:16 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:17.071767 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-073b051b-9d8d-4943-badd-a24231a71955 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:17.082133 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-073b051b-9d8d-4943-badd-a24231a71955 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1271 microversion: 2.1 time: 0.114407 Jul 20 11:50:17.095739 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 641/1270] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:16 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:18.004468 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-a801616b-41a5-4ea1-8fe6-6d0a73422faa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:18.005230 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-a801616b-41a5-4ea1-8fe6-6d0a73422faa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:18.012138 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a801616b-41a5-4ea1-8fe6-6d0a73422faa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:18.012584 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a801616b-41a5-4ea1-8fe6-6d0a73422faa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:18.013388 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a801616b-41a5-4ea1-8fe6-6d0a73422faa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:18.013826 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-a801616b-41a5-4ea1-8fe6-6d0a73422faa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:18.077114 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-a801616b-41a5-4ea1-8fe6-6d0a73422faa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:18.085172 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-a801616b-41a5-4ea1-8fe6-6d0a73422faa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1233 microversion: 2.1 time: 0.084462 Jul 20 11:50:18.085742 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 630/1271] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:17 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1233 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:50:18.102955 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-d193211e-6b65-4647-a99c-5a6d28d6b913 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:18.103551 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-d193211e-6b65-4647-a99c-5a6d28d6b913 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:18.110478 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d193211e-6b65-4647-a99c-5a6d28d6b913 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:18.110922 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d193211e-6b65-4647-a99c-5a6d28d6b913 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:18.111694 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d193211e-6b65-4647-a99c-5a6d28d6b913 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:18.112122 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-d193211e-6b65-4647-a99c-5a6d28d6b913 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:18.251214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-d193211e-6b65-4647-a99c-5a6d28d6b913 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:18.258947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-d193211e-6b65-4647-a99c-5a6d28d6b913 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1313 microversion: 2.1 time: 0.159913 Jul 20 11:50:18.259526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 642/1272] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:18 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:18.468727 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-d0e8452c-4d2a-48a2-b249-1b933b676e63 req-6ea826ea-e61e-40e2-a594-6cbd3156bf5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a26f19-d32a-45b3-8e2a-c3a1e7571688", "tag": "b6f61216-cbd7-423f-94ba-c7be4f57ad4f"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:50:18.477649 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-d0e8452c-4d2a-48a2-b249-1b933b676e63 req-6ea826ea-e61e-40e2-a594-6cbd3156bf5b service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:18.478093 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-d0e8452c-4d2a-48a2-b249-1b933b676e63 req-6ea826ea-e61e-40e2-a594-6cbd3156bf5b service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:18.490069 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-d0e8452c-4d2a-48a2-b249-1b933b676e63 req-6ea826ea-e61e-40e2-a594-6cbd3156bf5b service nova] Creating event network-changed:b6f61216-cbd7-423f-94ba-c7be4f57ad4f for instance 24a26f19-d32a-45b3-8e2a-c3a1e7571688 on hv-cinder-82282 Jul 20 11:50:18.495026 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-d0e8452c-4d2a-48a2-b249-1b933b676e63 req-6ea826ea-e61e-40e2-a594-6cbd3156bf5b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030078 Jul 20 11:50:18.495629 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 631/1273] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:50:19.102873 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fdb770d0-2c2a-41c4-b7da-98633f000b30 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:19.103392 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fdb770d0-2c2a-41c4-b7da-98633f000b30 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:19.111417 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdb770d0-2c2a-41c4-b7da-98633f000b30 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:19.111858 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdb770d0-2c2a-41c4-b7da-98633f000b30 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:19.112628 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdb770d0-2c2a-41c4-b7da-98633f000b30 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:19.113089 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fdb770d0-2c2a-41c4-b7da-98633f000b30 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:19.178308 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fdb770d0-2c2a-41c4-b7da-98633f000b30 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:19.185949 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fdb770d0-2c2a-41c4-b7da-98633f000b30 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1233 microversion: 2.1 time: 0.087274 Jul 20 11:50:19.186516 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 643/1274] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:19 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:19.277639 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-43a659a6-f641-419f-97dd-22a80f9b587e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:19.278352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-43a659a6-f641-419f-97dd-22a80f9b587e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:19.285322 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43a659a6-f641-419f-97dd-22a80f9b587e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:19.285762 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43a659a6-f641-419f-97dd-22a80f9b587e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:19.286538 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43a659a6-f641-419f-97dd-22a80f9b587e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:19.287018 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-43a659a6-f641-419f-97dd-22a80f9b587e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:19.427030 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-43a659a6-f641-419f-97dd-22a80f9b587e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:19.434485 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-43a659a6-f641-419f-97dd-22a80f9b587e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1313 microversion: 2.1 time: 0.162384 Jul 20 11:50:19.435084 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 632/1275] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:19 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:20.202608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4bb91d15-fa6b-4f8e-9f2c-88b0d220845c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:20.203393 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4bb91d15-fa6b-4f8e-9f2c-88b0d220845c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:20.210144 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb91d15-fa6b-4f8e-9f2c-88b0d220845c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:20.210592 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb91d15-fa6b-4f8e-9f2c-88b0d220845c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:20.216844 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb91d15-fa6b-4f8e-9f2c-88b0d220845c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:20.216844 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4bb91d15-fa6b-4f8e-9f2c-88b0d220845c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:20.274924 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4bb91d15-fa6b-4f8e-9f2c-88b0d220845c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:20.283164 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4bb91d15-fa6b-4f8e-9f2c-88b0d220845c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1233 microversion: 2.1 time: 0.084272 Jul 20 11:50:20.283733 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 644/1276] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:20 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1233 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:20.451317 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b96420cf-0380-4432-b047-3ae28f44d246 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:20.451939 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b96420cf-0380-4432-b047-3ae28f44d246 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:20.458727 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b96420cf-0380-4432-b047-3ae28f44d246 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:20.459165 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b96420cf-0380-4432-b047-3ae28f44d246 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:20.459927 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b96420cf-0380-4432-b047-3ae28f44d246 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:20.460417 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b96420cf-0380-4432-b047-3ae28f44d246 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:20.596663 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b96420cf-0380-4432-b047-3ae28f44d246 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:20.606408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b96420cf-0380-4432-b047-3ae28f44d246 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1313 microversion: 2.1 time: 0.158901 Jul 20 11:50:20.612020 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 633/1277] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:20 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:21.300272 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-fc69d51c-b059-4148-897c-6ee1f6344942 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:21.300898 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-fc69d51c-b059-4148-897c-6ee1f6344942 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:21.310936 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc69d51c-b059-4148-897c-6ee1f6344942 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:21.311506 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc69d51c-b059-4148-897c-6ee1f6344942 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:21.312312 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc69d51c-b059-4148-897c-6ee1f6344942 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:21.312753 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-fc69d51c-b059-4148-897c-6ee1f6344942 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:21.377840 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-fc69d51c-b059-4148-897c-6ee1f6344942 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:21.382383 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-fc69d51c-b059-4148-897c-6ee1f6344942 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1289 microversion: 2.1 time: 0.085975 Jul 20 11:50:21.382990 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 645/1278] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:21 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:21.623402 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8edff64c-08ff-4efe-9c11-a488786a8fa9 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:21.624033 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8edff64c-08ff-4efe-9c11-a488786a8fa9 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:21.630718 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8edff64c-08ff-4efe-9c11-a488786a8fa9 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:21.631201 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8edff64c-08ff-4efe-9c11-a488786a8fa9 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:21.631996 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8edff64c-08ff-4efe-9c11-a488786a8fa9 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:21.632452 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8edff64c-08ff-4efe-9c11-a488786a8fa9 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:21.771881 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8edff64c-08ff-4efe-9c11-a488786a8fa9 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:21.777621 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8edff64c-08ff-4efe-9c11-a488786a8fa9 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1313 microversion: 2.1 time: 0.158067 Jul 20 11:50:21.778190 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 634/1279] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:21 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:22.400419 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e47b8b6f-d512-4ecc-8e0b-6563d3e8cc4c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:22.401067 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e47b8b6f-d512-4ecc-8e0b-6563d3e8cc4c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:22.408905 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e47b8b6f-d512-4ecc-8e0b-6563d3e8cc4c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:22.409362 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e47b8b6f-d512-4ecc-8e0b-6563d3e8cc4c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:22.410152 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e47b8b6f-d512-4ecc-8e0b-6563d3e8cc4c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:22.410596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e47b8b6f-d512-4ecc-8e0b-6563d3e8cc4c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:22.496224 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e47b8b6f-d512-4ecc-8e0b-6563d3e8cc4c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:22.504823 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e47b8b6f-d512-4ecc-8e0b-6563d3e8cc4c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1297 microversion: 2.1 time: 0.109045 Jul 20 11:50:22.505499 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 646/1280] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:22 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1297 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:22.795030 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-419a34a9-b945-492d-bb26-f20744928757 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:22.795525 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-419a34a9-b945-492d-bb26-f20744928757 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:22.808700 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-419a34a9-b945-492d-bb26-f20744928757 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:22.809248 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-419a34a9-b945-492d-bb26-f20744928757 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:22.810046 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-419a34a9-b945-492d-bb26-f20744928757 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:22.810477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-419a34a9-b945-492d-bb26-f20744928757 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:23.029123 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-419a34a9-b945-492d-bb26-f20744928757 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:23.036736 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-419a34a9-b945-492d-bb26-f20744928757 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1313 microversion: 2.1 time: 0.245814 Jul 20 11:50:23.037602 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 635/1281] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:22 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:23.531384 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-3c9cbdaa-d8c2-4fa4-b71f-2685f3bb10c2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:23.532702 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-3c9cbdaa-d8c2-4fa4-b71f-2685f3bb10c2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:23.543506 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c9cbdaa-d8c2-4fa4-b71f-2685f3bb10c2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:23.548914 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c9cbdaa-d8c2-4fa4-b71f-2685f3bb10c2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:23.548914 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c9cbdaa-d8c2-4fa4-b71f-2685f3bb10c2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:23.548914 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-3c9cbdaa-d8c2-4fa4-b71f-2685f3bb10c2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:23.703229 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-3c9cbdaa-d8c2-4fa4-b71f-2685f3bb10c2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:23.713406 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-3c9cbdaa-d8c2-4fa4-b71f-2685f3bb10c2 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.190767 Jul 20 11:50:23.714081 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 647/1282] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:23 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:24.054156 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-d0932c26-7764-4168-8c87-a8dc430b082e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:24.055365 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-d0932c26-7764-4168-8c87-a8dc430b082e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:24.061923 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0932c26-7764-4168-8c87-a8dc430b082e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:24.062370 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0932c26-7764-4168-8c87-a8dc430b082e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:24.063132 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0932c26-7764-4168-8c87-a8dc430b082e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:24.063562 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-d0932c26-7764-4168-8c87-a8dc430b082e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:24.195275 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-d0932c26-7764-4168-8c87-a8dc430b082e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:24.202964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-d0932c26-7764-4168-8c87-a8dc430b082e tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1313 microversion: 2.1 time: 0.152644 Jul 20 11:50:24.203468 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 636/1283] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:24 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:24.736983 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-efc74b24-e7f2-481b-8ac6-9ee4a28673c8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:24.738095 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-efc74b24-e7f2-481b-8ac6-9ee4a28673c8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:24.748205 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efc74b24-e7f2-481b-8ac6-9ee4a28673c8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:24.748658 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efc74b24-e7f2-481b-8ac6-9ee4a28673c8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:24.749601 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efc74b24-e7f2-481b-8ac6-9ee4a28673c8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:24.750166 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-efc74b24-e7f2-481b-8ac6-9ee4a28673c8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:24.885859 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-efc74b24-e7f2-481b-8ac6-9ee4a28673c8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:24.893296 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-efc74b24-e7f2-481b-8ac6-9ee4a28673c8 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.161593 Jul 20 11:50:24.893880 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 648/1284] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:24 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:25.220648 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-50835a39-1b84-4df2-b006-a6afbbcd4b35 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:25.221436 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-50835a39-1b84-4df2-b006-a6afbbcd4b35 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:25.227973 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50835a39-1b84-4df2-b006-a6afbbcd4b35 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:25.230876 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50835a39-1b84-4df2-b006-a6afbbcd4b35 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:25.230876 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50835a39-1b84-4df2-b006-a6afbbcd4b35 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:25.230876 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-50835a39-1b84-4df2-b006-a6afbbcd4b35 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:25.362196 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-50835a39-1b84-4df2-b006-a6afbbcd4b35 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:25.370662 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-50835a39-1b84-4df2-b006-a6afbbcd4b35 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1313 microversion: 2.1 time: 0.154223 Jul 20 11:50:25.371238 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 637/1285] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:25 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:25.912251 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0a3f3a79-2951-4ab4-8132-d6370a2a2632 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:25.914695 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0a3f3a79-2951-4ab4-8132-d6370a2a2632 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:25.916467 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=4 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:25.918010 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=16 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:25.923673 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a3f3a79-2951-4ab4-8132-d6370a2a2632 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:25.924124 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a3f3a79-2951-4ab4-8132-d6370a2a2632 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:25.924936 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a3f3a79-2951-4ab4-8132-d6370a2a2632 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:25.925374 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0a3f3a79-2951-4ab4-8132-d6370a2a2632 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:26.155485 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0a3f3a79-2951-4ab4-8132-d6370a2a2632 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:26.159916 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:26.165290 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0a3f3a79-2951-4ab4-8132-d6370a2a2632 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.258120 Jul 20 11:50:26.166022 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 649/1286] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:25 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:50:26.364004 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-2c9a7020-8958-4663-bb4f-a8ba06489ec0 req-c8c7be82-6a7e-4ae9-8be2-d76c076b9e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9e27b9-9125-4eb4-adcd-de1f576d0f95", "tag": "d2551346-d102-4572-aedc-59c2a295d4c3"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:50:26.385310 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2c9a7020-8958-4663-bb4f-a8ba06489ec0 req-c8c7be82-6a7e-4ae9-8be2-d76c076b9e5f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:26.385749 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2c9a7020-8958-4663-bb4f-a8ba06489ec0 req-c8c7be82-6a7e-4ae9-8be2-d76c076b9e5f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:26.387501 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-46230b78-5537-4d02-90d8-8b5cd048d1ba tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:26.388128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-46230b78-5537-4d02-90d8-8b5cd048d1ba tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:26.395464 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46230b78-5537-4d02-90d8-8b5cd048d1ba tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:26.395914 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46230b78-5537-4d02-90d8-8b5cd048d1ba tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:26.396759 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46230b78-5537-4d02-90d8-8b5cd048d1ba tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:26.397147 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-46230b78-5537-4d02-90d8-8b5cd048d1ba tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:26.409090 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-2c9a7020-8958-4663-bb4f-a8ba06489ec0 req-c8c7be82-6a7e-4ae9-8be2-d76c076b9e5f service nova] Creating event network-changed:d2551346-d102-4572-aedc-59c2a295d4c3 for instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 on hv-cinder-82282 Jul 20 11:50:26.417354 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-2c9a7020-8958-4663-bb4f-a8ba06489ec0 req-c8c7be82-6a7e-4ae9-8be2-d76c076b9e5f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053969 Jul 20 11:50:26.417354 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 638/1287] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:50:26.608289 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-46230b78-5537-4d02-90d8-8b5cd048d1ba tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:26.616036 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-46230b78-5537-4d02-90d8-8b5cd048d1ba tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1313 microversion: 2.1 time: 0.232338 Jul 20 11:50:26.616622 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 650/1288] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:26 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:27.180169 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=8 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:27.184494 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ebc58814-f7c1-4887-8064-059f36fdeeaa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:27.185238 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ebc58814-f7c1-4887-8064-059f36fdeeaa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:27.191996 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebc58814-f7c1-4887-8064-059f36fdeeaa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:27.200738 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebc58814-f7c1-4887-8064-059f36fdeeaa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:27.200738 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebc58814-f7c1-4887-8064-059f36fdeeaa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:27.200738 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ebc58814-f7c1-4887-8064-059f36fdeeaa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:27.340551 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ebc58814-f7c1-4887-8064-059f36fdeeaa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:27.348114 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ebc58814-f7c1-4887-8064-059f36fdeeaa tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.169493 Jul 20 11:50:27.348685 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 639/1289] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:27 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:27.633568 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-85890e75-4ccb-43b9-a077-8627810a3bfd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:27.634240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-85890e75-4ccb-43b9-a077-8627810a3bfd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:27.641172 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85890e75-4ccb-43b9-a077-8627810a3bfd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:27.641644 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85890e75-4ccb-43b9-a077-8627810a3bfd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:27.642523 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85890e75-4ccb-43b9-a077-8627810a3bfd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:27.642994 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-85890e75-4ccb-43b9-a077-8627810a3bfd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:27.777501 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-85890e75-4ccb-43b9-a077-8627810a3bfd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:27.785379 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-85890e75-4ccb-43b9-a077-8627810a3bfd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1313 microversion: 2.1 time: 0.155863 Jul 20 11:50:27.785951 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 651/1290] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:27 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:28.366085 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8f74cb1d-96fe-489f-9e40-72c6cc8129e6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:28.366719 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8f74cb1d-96fe-489f-9e40-72c6cc8129e6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:28.373986 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f74cb1d-96fe-489f-9e40-72c6cc8129e6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:28.374571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f74cb1d-96fe-489f-9e40-72c6cc8129e6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:28.375356 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f74cb1d-96fe-489f-9e40-72c6cc8129e6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:28.375800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8f74cb1d-96fe-489f-9e40-72c6cc8129e6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:28.380193 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:28.627053 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8f74cb1d-96fe-489f-9e40-72c6cc8129e6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:28.634343 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8f74cb1d-96fe-489f-9e40-72c6cc8129e6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.272505 Jul 20 11:50:28.634906 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 640/1291] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:28 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:28.802920 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b3de6f7f-9950-4512-98a6-bcc8ec7ae9bd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:28.807833 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b3de6f7f-9950-4512-98a6-bcc8ec7ae9bd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:28.810153 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3de6f7f-9950-4512-98a6-bcc8ec7ae9bd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:28.810592 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3de6f7f-9950-4512-98a6-bcc8ec7ae9bd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:28.811364 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3de6f7f-9950-4512-98a6-bcc8ec7ae9bd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:28.811808 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3de6f7f-9950-4512-98a6-bcc8ec7ae9bd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:28.946997 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b3de6f7f-9950-4512-98a6-bcc8ec7ae9bd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:28.954780 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b3de6f7f-9950-4512-98a6-bcc8ec7ae9bd tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1313 microversion: 2.1 time: 0.155802 Jul 20 11:50:28.955495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 652/1292] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:28 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:29.652099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-459c763d-e68a-4942-922c-f873673d07dc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:29.652711 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-459c763d-e68a-4942-922c-f873673d07dc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:29.660413 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-459c763d-e68a-4942-922c-f873673d07dc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:29.660800 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-459c763d-e68a-4942-922c-f873673d07dc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:29.661604 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-459c763d-e68a-4942-922c-f873673d07dc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:29.662002 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-459c763d-e68a-4942-922c-f873673d07dc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:29.832597 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-459c763d-e68a-4942-922c-f873673d07dc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:29.839877 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-459c763d-e68a-4942-922c-f873673d07dc tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.192194 Jul 20 11:50:29.840451 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 641/1293] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:29 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:29.972157 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e57930ba-0995-495b-bdb1-e37dcbb9371f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:29.972763 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e57930ba-0995-495b-bdb1-e37dcbb9371f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:29.979450 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e57930ba-0995-495b-bdb1-e37dcbb9371f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:29.979892 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e57930ba-0995-495b-bdb1-e37dcbb9371f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:29.980658 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e57930ba-0995-495b-bdb1-e37dcbb9371f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:29.981114 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e57930ba-0995-495b-bdb1-e37dcbb9371f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:30.120275 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e57930ba-0995-495b-bdb1-e37dcbb9371f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:30.128869 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e57930ba-0995-495b-bdb1-e37dcbb9371f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1313 microversion: 2.1 time: 0.160766 Jul 20 11:50:30.129407 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 653/1294] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:29 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:30.556759 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-2331aad6-0d71-4b54-8388-421833d30a25 req-65d45c8a-195a-47f6-b167-f18baf0b4ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a26f19-d32a-45b3-8e2a-c3a1e7571688", "name": "network-vif-plugged", "status": "completed", "tag": "b6f61216-cbd7-423f-94ba-c7be4f57ad4f"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:50:30.565892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2331aad6-0d71-4b54-8388-421833d30a25 req-65d45c8a-195a-47f6-b167-f18baf0b4ae7 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:30.566341 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-2331aad6-0d71-4b54-8388-421833d30a25 req-65d45c8a-195a-47f6-b167-f18baf0b4ae7 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:30.581554 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-2331aad6-0d71-4b54-8388-421833d30a25 req-65d45c8a-195a-47f6-b167-f18baf0b4ae7 service nova] Creating event network-vif-plugged:b6f61216-cbd7-423f-94ba-c7be4f57ad4f for instance 24a26f19-d32a-45b3-8e2a-c3a1e7571688 on hv-cinder-82282 Jul 20 11:50:30.590646 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-2331aad6-0d71-4b54-8388-421833d30a25 req-65d45c8a-195a-47f6-b167-f18baf0b4ae7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038728 Jul 20 11:50:30.591253 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 642/1295] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:50:30.857358 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6bcd28d0-483f-4d9e-a70f-88a7a56317d0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:30.857963 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6bcd28d0-483f-4d9e-a70f-88a7a56317d0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:30.864045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6bcd28d0-483f-4d9e-a70f-88a7a56317d0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:30.864494 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6bcd28d0-483f-4d9e-a70f-88a7a56317d0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:30.865432 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6bcd28d0-483f-4d9e-a70f-88a7a56317d0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:30.865871 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6bcd28d0-483f-4d9e-a70f-88a7a56317d0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:31.000663 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-6bcd28d0-483f-4d9e-a70f-88a7a56317d0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:31.008218 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6bcd28d0-483f-4d9e-a70f-88a7a56317d0 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.154857 Jul 20 11:50:31.008815 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 654/1296] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:30 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:31.147820 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c8df435e-d3ce-4bda-a841-7843bb8affee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:31.149084 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c8df435e-d3ce-4bda-a841-7843bb8affee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:31.155423 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8df435e-d3ce-4bda-a841-7843bb8affee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:31.162836 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8df435e-d3ce-4bda-a841-7843bb8affee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:31.162836 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8df435e-d3ce-4bda-a841-7843bb8affee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:31.162836 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c8df435e-d3ce-4bda-a841-7843bb8affee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:31.293870 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c8df435e-d3ce-4bda-a841-7843bb8affee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:31.301795 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c8df435e-d3ce-4bda-a841-7843bb8affee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1313 microversion: 2.1 time: 0.158631 Jul 20 11:50:31.302370 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 643/1297] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:31 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:32.025789 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9ca3b07b-a350-4589-b228-689389f5a736 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:32.026513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9ca3b07b-a350-4589-b228-689389f5a736 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:32.035160 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ca3b07b-a350-4589-b228-689389f5a736 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:32.035813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ca3b07b-a350-4589-b228-689389f5a736 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:32.037059 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ca3b07b-a350-4589-b228-689389f5a736 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:32.037700 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9ca3b07b-a350-4589-b228-689389f5a736 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:32.173435 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9ca3b07b-a350-4589-b228-689389f5a736 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:32.181810 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9ca3b07b-a350-4589-b228-689389f5a736 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.160398 Jul 20 11:50:32.190816 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 655/1298] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:32 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:32.327670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5fab37ea-2a96-4021-82bf-f0259d7b8a90 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:32.327670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-5fab37ea-2a96-4021-82bf-f0259d7b8a90 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:32.327670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fab37ea-2a96-4021-82bf-f0259d7b8a90 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:32.327670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fab37ea-2a96-4021-82bf-f0259d7b8a90 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:32.328519 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fab37ea-2a96-4021-82bf-f0259d7b8a90 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:32.328519 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-5fab37ea-2a96-4021-82bf-f0259d7b8a90 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:32.527863 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-5fab37ea-2a96-4021-82bf-f0259d7b8a90 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:32.536210 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5fab37ea-2a96-4021-82bf-f0259d7b8a90 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1313 microversion: 2.1 time: 0.221964 Jul 20 11:50:32.536821 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 644/1299] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:32 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:33.200331 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b3cf6e9c-518e-4607-a7a2-e373b1182902 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:33.201051 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b3cf6e9c-518e-4607-a7a2-e373b1182902 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:33.207942 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3cf6e9c-518e-4607-a7a2-e373b1182902 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:33.208396 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3cf6e9c-518e-4607-a7a2-e373b1182902 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:33.209199 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3cf6e9c-518e-4607-a7a2-e373b1182902 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:33.209640 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b3cf6e9c-518e-4607-a7a2-e373b1182902 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:33.340014 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b3cf6e9c-518e-4607-a7a2-e373b1182902 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:33.347304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b3cf6e9c-518e-4607-a7a2-e373b1182902 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.151005 Jul 20 11:50:33.347933 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 656/1300] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:33 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:33.554488 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-12c5a1f7-d0ae-41be-b048-a13fd8f1a8aa tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:33.555971 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-12c5a1f7-d0ae-41be-b048-a13fd8f1a8aa tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:33.562076 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12c5a1f7-d0ae-41be-b048-a13fd8f1a8aa tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:33.562523 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12c5a1f7-d0ae-41be-b048-a13fd8f1a8aa tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:33.563296 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12c5a1f7-d0ae-41be-b048-a13fd8f1a8aa tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:33.563720 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-12c5a1f7-d0ae-41be-b048-a13fd8f1a8aa tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:33.772559 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-12c5a1f7-d0ae-41be-b048-a13fd8f1a8aa tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:33.781038 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-12c5a1f7-d0ae-41be-b048-a13fd8f1a8aa tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1497 microversion: 2.1 time: 0.230897 Jul 20 11:50:33.781649 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 645/1301] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:33 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1497 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:34.364952 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4eab0be8-8dbb-45c8-a347-e647686a8f05 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:34.366249 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4eab0be8-8dbb-45c8-a347-e647686a8f05 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:34.372987 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4eab0be8-8dbb-45c8-a347-e647686a8f05 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:34.373447 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4eab0be8-8dbb-45c8-a347-e647686a8f05 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:34.374232 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4eab0be8-8dbb-45c8-a347-e647686a8f05 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:34.374765 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4eab0be8-8dbb-45c8-a347-e647686a8f05 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:34.394864 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-1b20e534-51c8-4c8a-8451-fd0efdd51ced req-49320b4f-7064-4906-b039-b793fc8ee37c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9e27b9-9125-4eb4-adcd-de1f576d0f95", "name": "network-vif-plugged", "status": "completed", "tag": "d2551346-d102-4572-aedc-59c2a295d4c3"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:50:34.402783 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:34.405073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-1b20e534-51c8-4c8a-8451-fd0efdd51ced req-49320b4f-7064-4906-b039-b793fc8ee37c service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:34.405699 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-1b20e534-51c8-4c8a-8451-fd0efdd51ced req-49320b4f-7064-4906-b039-b793fc8ee37c service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:34.425235 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-1b20e534-51c8-4c8a-8451-fd0efdd51ced req-49320b4f-7064-4906-b039-b793fc8ee37c service nova] Creating event network-vif-plugged:d2551346-d102-4572-aedc-59c2a295d4c3 for instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 on hv-cinder-82282 Jul 20 11:50:34.425235 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-1b20e534-51c8-4c8a-8451-fd0efdd51ced req-49320b4f-7064-4906-b039-b793fc8ee37c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035257 Jul 20 11:50:34.425814 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 646/1302] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:50:34.527893 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-4eab0be8-8dbb-45c8-a347-e647686a8f05 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:34.535738 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4eab0be8-8dbb-45c8-a347-e647686a8f05 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.174750 Jul 20 11:50:34.536517 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 657/1303] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:34 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:50:34.923711 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0b6899d3-0baf-44aa-8971-50e2351d1347 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:34.924281 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0b6899d3-0baf-44aa-8971-50e2351d1347 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:34.932006 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b6899d3-0baf-44aa-8971-50e2351d1347 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:34.932446 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b6899d3-0baf-44aa-8971-50e2351d1347 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:34.934706 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b6899d3-0baf-44aa-8971-50e2351d1347 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:34.934706 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0b6899d3-0baf-44aa-8971-50e2351d1347 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:34.959594 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0b6899d3-0baf-44aa-8971-50e2351d1347 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:50:35.291382 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0b6899d3-0baf-44aa-8971-50e2351d1347 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "DELETE /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 204 len: 0 microversion: 2.1 time: 0.372177 Jul 20 11:50:35.291982 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 647/1304] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:50:34 2022] DELETE /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:50:35.303658 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-25e58e08-0715-4cde-9406-97ef7b8609df tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:35.304284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-25e58e08-0715-4cde-9406-97ef7b8609df tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:35.306160 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:35.310939 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25e58e08-0715-4cde-9406-97ef7b8609df tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:35.315884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25e58e08-0715-4cde-9406-97ef7b8609df tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:35.315884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25e58e08-0715-4cde-9406-97ef7b8609df tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:35.315884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-25e58e08-0715-4cde-9406-97ef7b8609df tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:35.460351 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-25e58e08-0715-4cde-9406-97ef7b8609df tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:35.469177 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-25e58e08-0715-4cde-9406-97ef7b8609df tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1503 microversion: 2.1 time: 0.172681 Jul 20 11:50:35.470143 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 658/1305] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:35 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:35.552559 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cc2a15b3-3def-401f-abdc-46f5e859c6c1 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:35.553209 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cc2a15b3-3def-401f-abdc-46f5e859c6c1 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:35.559802 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc2a15b3-3def-401f-abdc-46f5e859c6c1 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:35.560246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc2a15b3-3def-401f-abdc-46f5e859c6c1 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:35.561047 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc2a15b3-3def-401f-abdc-46f5e859c6c1 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:35.561481 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cc2a15b3-3def-401f-abdc-46f5e859c6c1 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:35.697975 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-cc2a15b3-3def-401f-abdc-46f5e859c6c1 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:35.705520 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cc2a15b3-3def-401f-abdc-46f5e859c6c1 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.157343 Jul 20 11:50:35.706130 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 648/1306] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:35 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:36.487575 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-55e073b3-8de0-48b2-9579-004973a817a0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:36.488240 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-55e073b3-8de0-48b2-9579-004973a817a0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:36.495322 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55e073b3-8de0-48b2-9579-004973a817a0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:36.495771 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55e073b3-8de0-48b2-9579-004973a817a0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:36.496531 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55e073b3-8de0-48b2-9579-004973a817a0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:36.497007 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-55e073b3-8de0-48b2-9579-004973a817a0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:36.636575 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-55e073b3-8de0-48b2-9579-004973a817a0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:36.644178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-55e073b3-8de0-48b2-9579-004973a817a0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1503 microversion: 2.1 time: 0.160497 Jul 20 11:50:36.644742 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 659/1307] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:36 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:36.721486 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-71e4a94a-74b5-474c-a399-f00ac32abadf tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:36.722093 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-71e4a94a-74b5-474c-a399-f00ac32abadf tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:36.728625 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-71e4a94a-74b5-474c-a399-f00ac32abadf tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:36.729093 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-71e4a94a-74b5-474c-a399-f00ac32abadf tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:36.729854 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-71e4a94a-74b5-474c-a399-f00ac32abadf tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:36.730278 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-71e4a94a-74b5-474c-a399-f00ac32abadf tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:37.115248 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-71e4a94a-74b5-474c-a399-f00ac32abadf tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:37.124246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-71e4a94a-74b5-474c-a399-f00ac32abadf tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.406719 Jul 20 11:50:37.124753 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 649/1308] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:36 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:37.661823 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-b29315cb-9a9e-406a-9a2b-8f626cd3c92c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:37.662395 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-b29315cb-9a9e-406a-9a2b-8f626cd3c92c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:37.669422 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b29315cb-9a9e-406a-9a2b-8f626cd3c92c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:37.669864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b29315cb-9a9e-406a-9a2b-8f626cd3c92c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:37.670623 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b29315cb-9a9e-406a-9a2b-8f626cd3c92c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:37.671056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-b29315cb-9a9e-406a-9a2b-8f626cd3c92c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:37.961908 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-b29315cb-9a9e-406a-9a2b-8f626cd3c92c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:37.969317 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-b29315cb-9a9e-406a-9a2b-8f626cd3c92c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1503 microversion: 2.1 time: 0.311687 Jul 20 11:50:37.969888 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 660/1309] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:37 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1503 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:38.142271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-ec79f9d5-8388-40fe-a540-ce4d938100fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:38.142865 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-ec79f9d5-8388-40fe-a540-ce4d938100fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:38.149949 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec79f9d5-8388-40fe-a540-ce4d938100fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:38.150387 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec79f9d5-8388-40fe-a540-ce4d938100fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:38.151139 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec79f9d5-8388-40fe-a540-ce4d938100fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:38.151569 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-ec79f9d5-8388-40fe-a540-ce4d938100fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:38.281804 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-ec79f9d5-8388-40fe-a540-ce4d938100fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:38.289098 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-ec79f9d5-8388-40fe-a540-ce4d938100fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.150732 Jul 20 11:50:38.289685 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 650/1310] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:38 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:38.986538 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e9ee7145-e386-42ab-be63-9d39c2e0cea0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:38.987143 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e9ee7145-e386-42ab-be63-9d39c2e0cea0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:38.993723 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9ee7145-e386-42ab-be63-9d39c2e0cea0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:38.997320 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9ee7145-e386-42ab-be63-9d39c2e0cea0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:38.997320 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9ee7145-e386-42ab-be63-9d39c2e0cea0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:38.997320 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e9ee7145-e386-42ab-be63-9d39c2e0cea0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:39.131061 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e9ee7145-e386-42ab-be63-9d39c2e0cea0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:39.139119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e9ee7145-e386-42ab-be63-9d39c2e0cea0 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1503 microversion: 2.1 time: 0.156495 Jul 20 11:50:39.139686 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 661/1311] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:38 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:39.306365 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-bf16fb6f-450a-486a-88fb-aefb2c3767a4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:39.306988 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-bf16fb6f-450a-486a-88fb-aefb2c3767a4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:39.313632 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf16fb6f-450a-486a-88fb-aefb2c3767a4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:39.314083 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf16fb6f-450a-486a-88fb-aefb2c3767a4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:39.314839 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf16fb6f-450a-486a-88fb-aefb2c3767a4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:39.315276 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-bf16fb6f-450a-486a-88fb-aefb2c3767a4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:39.449135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-bf16fb6f-450a-486a-88fb-aefb2c3767a4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:39.456829 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-bf16fb6f-450a-486a-88fb-aefb2c3767a4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.154850 Jul 20 11:50:39.457397 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 651/1312] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:39 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:40.157121 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-04976b35-4b8c-4519-96e0-5b01196fa57d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:40.157663 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-04976b35-4b8c-4519-96e0-5b01196fa57d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:40.166214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04976b35-4b8c-4519-96e0-5b01196fa57d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:40.166668 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04976b35-4b8c-4519-96e0-5b01196fa57d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:40.167459 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04976b35-4b8c-4519-96e0-5b01196fa57d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:40.167907 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-04976b35-4b8c-4519-96e0-5b01196fa57d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:40.297571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-04976b35-4b8c-4519-96e0-5b01196fa57d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:40.305419 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-04976b35-4b8c-4519-96e0-5b01196fa57d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1503 microversion: 2.1 time: 0.152316 Jul 20 11:50:40.306003 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 662/1313] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:40 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:40.474644 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-92c63fd4-f20a-41e1-8586-127051d26957 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:40.475192 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-92c63fd4-f20a-41e1-8586-127051d26957 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:40.481888 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92c63fd4-f20a-41e1-8586-127051d26957 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:40.483342 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92c63fd4-f20a-41e1-8586-127051d26957 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:40.483342 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92c63fd4-f20a-41e1-8586-127051d26957 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:40.483670 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-92c63fd4-f20a-41e1-8586-127051d26957 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:40.626626 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-92c63fd4-f20a-41e1-8586-127051d26957 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:40.635219 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-92c63fd4-f20a-41e1-8586-127051d26957 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.164978 Jul 20 11:50:40.635782 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 652/1314] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:40 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:41.322912 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-0048e128-1e45-4263-9356-14be9d4ac38a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:41.323523 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-0048e128-1e45-4263-9356-14be9d4ac38a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:41.330351 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0048e128-1e45-4263-9356-14be9d4ac38a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:41.330799 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0048e128-1e45-4263-9356-14be9d4ac38a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:41.331567 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0048e128-1e45-4263-9356-14be9d4ac38a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:41.332005 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-0048e128-1e45-4263-9356-14be9d4ac38a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:41.468001 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-0048e128-1e45-4263-9356-14be9d4ac38a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:41.475553 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-0048e128-1e45-4263-9356-14be9d4ac38a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1503 microversion: 2.1 time: 0.156521 Jul 20 11:50:41.476144 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 663/1315] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:41 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:41.651876 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-dd07547e-62d6-445a-8abf-6f5250502e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:41.652508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-dd07547e-62d6-445a-8abf-6f5250502e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:41.659698 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd07547e-62d6-445a-8abf-6f5250502e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:41.660135 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd07547e-62d6-445a-8abf-6f5250502e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:41.660933 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd07547e-62d6-445a-8abf-6f5250502e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:41.661361 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-dd07547e-62d6-445a-8abf-6f5250502e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:41.791660 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-dd07547e-62d6-445a-8abf-6f5250502e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:41.799418 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-dd07547e-62d6-445a-8abf-6f5250502e7c tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1362 microversion: 2.1 time: 0.151816 Jul 20 11:50:41.799989 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 653/1316] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:41 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:42.493845 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e2a2ad5e-89bb-4187-a93c-f9d3cb2c6445 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:42.494434 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-e2a2ad5e-89bb-4187-a93c-f9d3cb2c6445 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:42.501058 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e2a2ad5e-89bb-4187-a93c-f9d3cb2c6445 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:42.501500 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e2a2ad5e-89bb-4187-a93c-f9d3cb2c6445 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:42.502259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e2a2ad5e-89bb-4187-a93c-f9d3cb2c6445 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:42.502691 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-e2a2ad5e-89bb-4187-a93c-f9d3cb2c6445 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:42.652396 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-e2a2ad5e-89bb-4187-a93c-f9d3cb2c6445 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:42.657371 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e2a2ad5e-89bb-4187-a93c-f9d3cb2c6445 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1503 microversion: 2.1 time: 0.167808 Jul 20 11:50:42.658943 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 664/1317] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:42 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:42.815450 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-8322d133-10bc-41b1-9e39-559ccaec2f90 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:42.815977 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-8322d133-10bc-41b1-9e39-559ccaec2f90 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:42.823217 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8322d133-10bc-41b1-9e39-559ccaec2f90 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:42.823668 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8322d133-10bc-41b1-9e39-559ccaec2f90 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:42.824468 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8322d133-10bc-41b1-9e39-559ccaec2f90 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:42.824928 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-8322d133-10bc-41b1-9e39-559ccaec2f90 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:42.973403 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-8322d133-10bc-41b1-9e39-559ccaec2f90 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:42.981824 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-8322d133-10bc-41b1-9e39-559ccaec2f90 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1547 microversion: 2.1 time: 0.170272 Jul 20 11:50:42.987025 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 654/1318] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:42 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:42.998002 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-34a70b7a-10c6-434d-8e9b-80577f9d446a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:42.998524 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-34a70b7a-10c6-434d-8e9b-80577f9d446a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:43.004872 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34a70b7a-10c6-434d-8e9b-80577f9d446a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:43.005325 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34a70b7a-10c6-434d-8e9b-80577f9d446a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:43.006091 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34a70b7a-10c6-434d-8e9b-80577f9d446a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:43.006528 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-34a70b7a-10c6-434d-8e9b-80577f9d446a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:43.114132 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-34a70b7a-10c6-434d-8e9b-80577f9d446a tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119721 Jul 20 11:50:43.117556 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 665/1319] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 11:50:42 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:50:43.676845 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-2680cf3b-4ada-458d-8e3d-04fac051c99c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:43.677449 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-2680cf3b-4ada-458d-8e3d-04fac051c99c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:43.684240 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2680cf3b-4ada-458d-8e3d-04fac051c99c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:43.684687 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2680cf3b-4ada-458d-8e3d-04fac051c99c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:43.685532 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2680cf3b-4ada-458d-8e3d-04fac051c99c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:43.685958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-2680cf3b-4ada-458d-8e3d-04fac051c99c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:44.052018 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-2680cf3b-4ada-458d-8e3d-04fac051c99c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:44.061059 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-2680cf3b-4ada-458d-8e3d-04fac051c99c tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1503 microversion: 2.1 time: 0.387915 Jul 20 11:50:44.061904 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 655/1320] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:43 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1503 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:44.577012 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-62ceff2b-4249-47bb-b59f-85f53bfbaa02 req-d6254487-cb63-48ac-b3f6-e5969f394f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9e27b9-9125-4eb4-adcd-de1f576d0f95", "tag": "d2551346-d102-4572-aedc-59c2a295d4c3"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:50:44.585124 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-62ceff2b-4249-47bb-b59f-85f53bfbaa02 req-d6254487-cb63-48ac-b3f6-e5969f394f54 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:44.585592 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-62ceff2b-4249-47bb-b59f-85f53bfbaa02 req-d6254487-cb63-48ac-b3f6-e5969f394f54 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:44.597816 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-62ceff2b-4249-47bb-b59f-85f53bfbaa02 req-d6254487-cb63-48ac-b3f6-e5969f394f54 service nova] Creating event network-changed:d2551346-d102-4572-aedc-59c2a295d4c3 for instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 on hv-cinder-82282 Jul 20 11:50:44.604154 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-62ceff2b-4249-47bb-b59f-85f53bfbaa02 req-d6254487-cb63-48ac-b3f6-e5969f394f54 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031256 Jul 20 11:50:44.604986 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 666/1321] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:50:45.083776 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c13370b6-ead4-4e76-b225-0381f1c33753 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:45.084521 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c13370b6-ead4-4e76-b225-0381f1c33753 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:45.094685 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c13370b6-ead4-4e76-b225-0381f1c33753 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:45.097887 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c13370b6-ead4-4e76-b225-0381f1c33753 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:45.097887 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c13370b6-ead4-4e76-b225-0381f1c33753 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:45.097887 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c13370b6-ead4-4e76-b225-0381f1c33753 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:45.132709 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:45.143410 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c13370b6-ead4-4e76-b225-0381f1c33753 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:45.143940 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c13370b6-ead4-4e76-b225-0381f1c33753 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:45.144583 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-c13370b6-ead4-4e76-b225-0381f1c33753 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lazy-loading 'fault' on Instance uuid 24a26f19-d32a-45b3-8e2a-c3a1e7571688 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:50:45.193477 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c13370b6-ead4-4e76-b225-0381f1c33753 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:45.204576 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c13370b6-ead4-4e76-b225-0381f1c33753 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 200 len: 1303 microversion: 2.1 time: 0.124585 Jul 20 11:50:45.206199 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 656/1322] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:45 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:46.224213 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-99e11b95-13d5-4792-887f-15301fb9ba5f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:46.224966 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-99e11b95-13d5-4792-887f-15301fb9ba5f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 24a26f19-d32a-45b3-8e2a-c3a1e7571688] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:46.231896 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99e11b95-13d5-4792-887f-15301fb9ba5f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:46.232353 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99e11b95-13d5-4792-887f-15301fb9ba5f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:46.233295 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99e11b95-13d5-4792-887f-15301fb9ba5f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:46.233733 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-99e11b95-13d5-4792-887f-15301fb9ba5f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:46.250241 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-99e11b95-13d5-4792-887f-15301fb9ba5f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] HTTP exception thrown: Instance 24a26f19-d32a-45b3-8e2a-c3a1e7571688 could not be found. Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-99e11b95-13d5-4792-887f-15301fb9ba5f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Request method failure captured: Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 HTTP/1.1 Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-vtzVTnCzPzRCfjZP8pyOEuvzdkFk3YHHQAurRPg4Vd-T8o2-SjQcu8T2E8G6SxeSVZPZzL49jvW8ya7hbx0w_3Tij0u_OLOFneAvp-qPtyjtE7Ex5EZCVSnjIifO6RXAjZz-8a5bsiG3iL02M4it7RD3OlD58iZeGjCEb-T6t8mWk Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: e4cd929e5d1a40bf8073e26456a09684 Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesActionsTest-1294114921 Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:50:46.251928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:50:46.253752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e4cd929e5d1a40bf8073e26456a09684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e4cd929e5d1a40bf8073e26456a09684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e4cd929e5d1a40bf8073e26456a09684", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e4cd929e5d1a40bf8073e26456a09684"}]}] Jul 20 11:50:46.253752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesActionsTest-1294114921 Jul 20 11:50:46.253752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: e4cd929e5d1a40bf8073e26456a09684 Jul 20 11:50:46.253752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesActionsTest-1294114921 Jul 20 11:50:46.253752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesActionsTest-1294114921-project Jul 20 11:50:46.253752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:50:46.253752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:50:46.253752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 2fca61a3bb8145d2aba5cecf37e870c0 Jul 20 11:50:46.253752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesActionsTest-1294114921-project Jul 20 11:50:46.253752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:50:46.253752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance 24a26f19-d32a-45b3-8e2a-c3a1e7571688 could not be found. Jul 20 11:50:46.253752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': '24a26f19-d32a-45b3-8e2a-c3a1e7571688'} Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a26f19-d32a-45b3-8e2a-c3a1e7571688 could not be found. Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:50:46.254777 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a26f19-d32a-45b3-8e2a-c3a1e7571688 could not be found. Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a26f19-d32a-45b3-8e2a-c3a1e7571688 could not be found. Jul 20 11:50:46.256578 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:50:46.259108 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-99e11b95-13d5-4792-887f-15301fb9ba5f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Returning 404 to user: Instance 24a26f19-d32a-45b3-8e2a-c3a1e7571688 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:50:46.259108 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-99e11b95-13d5-4792-887f-15301fb9ba5f tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688" status: 404 len: 111 microversion: 2.1 time: 0.033978 Jul 20 11:50:46.259108 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 667/1323] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:46 2022] GET /compute/v2.1/servers/24a26f19-d32a-45b3-8e2a-c3a1e7571688 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:50:46.366175 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1015018818", "imageRef": "0a57e775-9ca6-485f-97ed-618a3a16db51", "flavorRef": "452", "networks": [{"uuid": "b4db7f72-f7af-4d02-bbbf-22d232c0d28d"}]}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:50:46.449218 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.network.neutron [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] validate_networks() for [('b4db7f72-f7af-4d02-bbbf-22d232c0d28d', None, None, None, None, None)] {{(pid=124830) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:50:46.637794 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-441c7c3e-8838-420c-a320-3741cf8ed178 req-4bed40c5-b83c-4e56-8672-36b82df827fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a26f19-d32a-45b3-8e2a-c3a1e7571688", "name": "network-vif-deleted", "tag": "b6f61216-cbd7-423f-94ba-c7be4f57ad4f"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:50:46.649306 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-441c7c3e-8838-420c-a320-3741cf8ed178 req-4bed40c5-b83c-4e56-8672-36b82df827fc service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:46.649903 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-441c7c3e-8838-420c-a320-3741cf8ed178 req-4bed40c5-b83c-4e56-8672-36b82df827fc service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:46.655612 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=100 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:46.669572 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-441c7c3e-8838-420c-a320-3741cf8ed178 req-4bed40c5-b83c-4e56-8672-36b82df827fc service nova] Creating event network-vif-deleted:b6f61216-cbd7-423f-94ba-c7be4f57ad4f for instance 24a26f19-d32a-45b3-8e2a-c3a1e7571688 on hv-cinder-82282 Jul 20 11:50:46.670570 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-441c7c3e-8838-420c-a320-3741cf8ed178 req-4bed40c5-b83c-4e56-8672-36b82df827fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039410 Jul 20 11:50:46.671355 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 668/1324] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:50:46.917878 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Flavor limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:50:46.918298 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Image limits 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:50:46.918765 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Flavor pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:50:46.919167 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Image pref 0:0:0 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:50:46.919573 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.virt.hardware [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124830) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:50:46.928656 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:46.929639 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:46.930438 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:46.930870 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:46.948099 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Getting quotas for project e4cd929e5d1a40bf8073e26456a09684. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:50:46.952213 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.quota [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Getting quotas for user 2fca61a3bb8145d2aba5cecf37e870c0 and project e4cd929e5d1a40bf8073e26456a09684. Resources: {'instances', 'ram', 'cores'} {{(pid=124830) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:50:46.964497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Going to run 1 instances... {{(pid=124830) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:50:46.966803 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a57e775-9ca6-485f-97ed-618a3a16db51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124830) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:50:47.089840 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-07d7ad4c-b633-4f5f-b7f1-3bb4311b21ee tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727925 Jul 20 11:50:47.090389 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 657/1325] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 11:50:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:50:47.108599 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-35af7362-6b80-4b23-ac24-692b33558b56 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:47.109845 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-35af7362-6b80-4b23-ac24-692b33558b56 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:47.173011 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-35af7362-6b80-4b23-ac24-692b33558b56 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:47.180086 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-35af7362-6b80-4b23-ac24-692b33558b56 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1214 microversion: 2.1 time: 0.079592 Jul 20 11:50:47.180670 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 669/1326] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:47 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:48.198484 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-64066303-fddc-4752-b36c-1724c92864b8 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:48.199033 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-64066303-fddc-4752-b36c-1724c92864b8 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:48.207524 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64066303-fddc-4752-b36c-1724c92864b8 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:48.207979 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64066303-fddc-4752-b36c-1724c92864b8 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:48.208805 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64066303-fddc-4752-b36c-1724c92864b8 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:48.209463 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-64066303-fddc-4752-b36c-1724c92864b8 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:48.276226 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-64066303-fddc-4752-b36c-1724c92864b8 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:48.284027 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-64066303-fddc-4752-b36c-1724c92864b8 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1218 microversion: 2.1 time: 0.089802 Jul 20 11:50:48.284611 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 658/1327] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:48 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:49.302638 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-80a7e8f1-e303-439e-a5a2-19c808fbaa23 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:49.303347 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-80a7e8f1-e303-439e-a5a2-19c808fbaa23 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:49.310327 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80a7e8f1-e303-439e-a5a2-19c808fbaa23 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:49.310830 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80a7e8f1-e303-439e-a5a2-19c808fbaa23 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:49.318082 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80a7e8f1-e303-439e-a5a2-19c808fbaa23 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:49.318082 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-80a7e8f1-e303-439e-a5a2-19c808fbaa23 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:49.381952 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-80a7e8f1-e303-439e-a5a2-19c808fbaa23 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:49.391402 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-80a7e8f1-e303-439e-a5a2-19c808fbaa23 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1274 microversion: 2.1 time: 0.092723 Jul 20 11:50:49.392089 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 670/1328] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:49 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:50:50.410076 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3b06cf62-86a5-4f4a-9f67-c75eb1128196 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:50.410699 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3b06cf62-86a5-4f4a-9f67-c75eb1128196 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:50.417653 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b06cf62-86a5-4f4a-9f67-c75eb1128196 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:50.418103 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b06cf62-86a5-4f4a-9f67-c75eb1128196 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:50.418893 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b06cf62-86a5-4f4a-9f67-c75eb1128196 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:50.419361 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3b06cf62-86a5-4f4a-9f67-c75eb1128196 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:50.561281 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3b06cf62-86a5-4f4a-9f67-c75eb1128196 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:50.569194 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3b06cf62-86a5-4f4a-9f67-c75eb1128196 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1314 microversion: 2.1 time: 0.163312 Jul 20 11:50:50.570649 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 659/1329] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:50 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:51.080743 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-b94e8a8d-0595-44cd-afad-cfec2bea948c req-220dc315-2521-4786-9f98-c810f176ec2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ee2c3e-b90d-4462-876b-871f24655e53", "tag": "570e097e-ab83-4fab-b3cc-b4caf9fe4420"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:50:51.090395 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-b94e8a8d-0595-44cd-afad-cfec2bea948c req-220dc315-2521-4786-9f98-c810f176ec2c service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:51.090927 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-b94e8a8d-0595-44cd-afad-cfec2bea948c req-220dc315-2521-4786-9f98-c810f176ec2c service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:51.102069 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-b94e8a8d-0595-44cd-afad-cfec2bea948c req-220dc315-2521-4786-9f98-c810f176ec2c service nova] Creating event network-changed:570e097e-ab83-4fab-b3cc-b4caf9fe4420 for instance 60ee2c3e-b90d-4462-876b-871f24655e53 on hv-cinder-82282 Jul 20 11:50:51.106942 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-b94e8a8d-0595-44cd-afad-cfec2bea948c req-220dc315-2521-4786-9f98-c810f176ec2c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029881 Jul 20 11:50:51.107564 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 671/1330] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:50:51.587329 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-533dc9bc-f970-4838-b37d-bc9ac4394467 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:51.588083 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-533dc9bc-f970-4838-b37d-bc9ac4394467 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:51.597259 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-533dc9bc-f970-4838-b37d-bc9ac4394467 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:51.597812 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-533dc9bc-f970-4838-b37d-bc9ac4394467 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:51.598724 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-533dc9bc-f970-4838-b37d-bc9ac4394467 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:51.599254 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-533dc9bc-f970-4838-b37d-bc9ac4394467 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:51.755383 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-533dc9bc-f970-4838-b37d-bc9ac4394467 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:51.762890 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-533dc9bc-f970-4838-b37d-bc9ac4394467 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1314 microversion: 2.1 time: 0.179871 Jul 20 11:50:51.763468 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 660/1331] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:51 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:52.780716 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a211fd08-22bc-460e-b56c-3922ad8aef9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:52.781469 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a211fd08-22bc-460e-b56c-3922ad8aef9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:52.788001 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a211fd08-22bc-460e-b56c-3922ad8aef9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:52.788492 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a211fd08-22bc-460e-b56c-3922ad8aef9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:52.789292 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a211fd08-22bc-460e-b56c-3922ad8aef9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:52.789721 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a211fd08-22bc-460e-b56c-3922ad8aef9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:52.925410 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a211fd08-22bc-460e-b56c-3922ad8aef9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:52.934196 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a211fd08-22bc-460e-b56c-3922ad8aef9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1314 microversion: 2.1 time: 0.158196 Jul 20 11:50:52.934873 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 672/1332] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:52 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:53.951969 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-3a4dff28-63fb-4ef9-9aa8-82fcdf8dd60a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:53.952773 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-3a4dff28-63fb-4ef9-9aa8-82fcdf8dd60a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:53.959653 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a4dff28-63fb-4ef9-9aa8-82fcdf8dd60a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:53.960101 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a4dff28-63fb-4ef9-9aa8-82fcdf8dd60a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:53.963284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a4dff28-63fb-4ef9-9aa8-82fcdf8dd60a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:53.967640 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-3a4dff28-63fb-4ef9-9aa8-82fcdf8dd60a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:54.110659 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-3a4dff28-63fb-4ef9-9aa8-82fcdf8dd60a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:54.118474 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-3a4dff28-63fb-4ef9-9aa8-82fcdf8dd60a tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1314 microversion: 2.1 time: 0.170393 Jul 20 11:50:54.118998 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 661/1333] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:53 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:55.136277 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a6244acf-7ad7-47da-ad05-0b2914971555 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:55.136999 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a6244acf-7ad7-47da-ad05-0b2914971555 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:55.144937 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6244acf-7ad7-47da-ad05-0b2914971555 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:55.145126 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6244acf-7ad7-47da-ad05-0b2914971555 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:55.145748 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6244acf-7ad7-47da-ad05-0b2914971555 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:55.146187 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a6244acf-7ad7-47da-ad05-0b2914971555 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:55.276347 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-a6244acf-7ad7-47da-ad05-0b2914971555 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:55.284020 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a6244acf-7ad7-47da-ad05-0b2914971555 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1314 microversion: 2.1 time: 0.151482 Jul 20 11:50:55.284596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 673/1334] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:55 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:56.301490 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-61531abf-efee-4c9f-b943-e6917400ed30 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:56.302396 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-61531abf-efee-4c9f-b943-e6917400ed30 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:56.309739 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61531abf-efee-4c9f-b943-e6917400ed30 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:56.310181 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61531abf-efee-4c9f-b943-e6917400ed30 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:56.310949 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61531abf-efee-4c9f-b943-e6917400ed30 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:56.311386 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-61531abf-efee-4c9f-b943-e6917400ed30 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:56.457558 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-61531abf-efee-4c9f-b943-e6917400ed30 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:56.465100 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-61531abf-efee-4c9f-b943-e6917400ed30 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1314 microversion: 2.1 time: 0.167483 Jul 20 11:50:56.465740 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 662/1335] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:56 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:57.482648 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-de333ee2-564d-4abc-a177-d63c4a374e21 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:57.483415 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-de333ee2-564d-4abc-a177-d63c4a374e21 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:57.487087 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell0:SELECT=2 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:57.490730 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de333ee2-564d-4abc-a177-d63c4a374e21 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:57.495897 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de333ee2-564d-4abc-a177-d63c4a374e21 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:57.495897 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de333ee2-564d-4abc-a177-d63c4a374e21 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:57.495897 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-de333ee2-564d-4abc-a177-d63c4a374e21 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:57.626000 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-de333ee2-564d-4abc-a177-d63c4a374e21 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:57.634134 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-de333ee2-564d-4abc-a177-d63c4a374e21 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1314 microversion: 2.1 time: 0.155870 Jul 20 11:50:57.638137 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 674/1336] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:57 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:50:58.620558 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-9b95a1cd-bc83-4d99-b4e7-b2e3e8444248 req-b19702f9-3358-45d2-ad3b-d90e96024cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ee2c3e-b90d-4462-876b-871f24655e53", "name": "network-vif-plugged", "status": "completed", "tag": "570e097e-ab83-4fab-b3cc-b4caf9fe4420"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:50:58.623905 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:58.624694 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell0:SELECT=6 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:50:58.630719 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-9b95a1cd-bc83-4d99-b4e7-b2e3e8444248 req-b19702f9-3358-45d2-ad3b-d90e96024cb1 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:58.637061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-9b95a1cd-bc83-4d99-b4e7-b2e3e8444248 req-b19702f9-3358-45d2-ad3b-d90e96024cb1 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:58.643258 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-9b95a1cd-bc83-4d99-b4e7-b2e3e8444248 req-b19702f9-3358-45d2-ad3b-d90e96024cb1 service nova] Creating event network-vif-plugged:570e097e-ab83-4fab-b3cc-b4caf9fe4420 for instance 60ee2c3e-b90d-4462-876b-871f24655e53 on hv-cinder-82282 Jul 20 11:50:58.648730 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-9b95a1cd-bc83-4d99-b4e7-b2e3e8444248 req-b19702f9-3358-45d2-ad3b-d90e96024cb1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032761 Jul 20 11:50:58.649494 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 663/1337] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:50:58.650790 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-961660fd-d48c-48d7-9d18-47f380d685b5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:58.651433 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-961660fd-d48c-48d7-9d18-47f380d685b5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:58.657898 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-961660fd-d48c-48d7-9d18-47f380d685b5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:58.658347 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-961660fd-d48c-48d7-9d18-47f380d685b5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:58.659389 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-961660fd-d48c-48d7-9d18-47f380d685b5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:58.659825 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-961660fd-d48c-48d7-9d18-47f380d685b5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:58.805238 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-961660fd-d48c-48d7-9d18-47f380d685b5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:50:58.815230 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-961660fd-d48c-48d7-9d18-47f380d685b5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1314 microversion: 2.1 time: 0.168287 Jul 20 11:50:58.815997 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 675/1338] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:58 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:50:59.839721 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1f3f1f2a-acbc-4a58-ab85-8e7c1348d9a6 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:50:59.840415 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1f3f1f2a-acbc-4a58-ab85-8e7c1348d9a6 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:50:59.848004 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f3f1f2a-acbc-4a58-ab85-8e7c1348d9a6 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:59.848473 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f3f1f2a-acbc-4a58-ab85-8e7c1348d9a6 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:59.849269 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f3f1f2a-acbc-4a58-ab85-8e7c1348d9a6 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:50:59.849703 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1f3f1f2a-acbc-4a58-ab85-8e7c1348d9a6 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:50:59.994493 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1f3f1f2a-acbc-4a58-ab85-8e7c1348d9a6 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:51:00.002677 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1f3f1f2a-acbc-4a58-ab85-8e7c1348d9a6 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1314 microversion: 2.1 time: 0.168130 Jul 20 11:51:00.003263 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 664/1339] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:50:59 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:51:01.019826 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8cad2f9b-dbf7-4527-ada9-342a1bbecd01 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:51:01.020431 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8cad2f9b-dbf7-4527-ada9-342a1bbecd01 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:51:01.028418 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cad2f9b-dbf7-4527-ada9-342a1bbecd01 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:01.028898 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cad2f9b-dbf7-4527-ada9-342a1bbecd01 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:01.029667 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cad2f9b-dbf7-4527-ada9-342a1bbecd01 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:01.030101 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8cad2f9b-dbf7-4527-ada9-342a1bbecd01 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:01.172713 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-8cad2f9b-dbf7-4527-ada9-342a1bbecd01 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:51:01.180332 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8cad2f9b-dbf7-4527-ada9-342a1bbecd01 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1314 microversion: 2.1 time: 0.164591 Jul 20 11:51:01.181899 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 676/1340] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:51:01 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:51:02.197795 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b09e83fd-beb1-4ddd-9fbb-6bf27d8a0fa5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:51:02.198379 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b09e83fd-beb1-4ddd-9fbb-6bf27d8a0fa5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:51:02.204704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b09e83fd-beb1-4ddd-9fbb-6bf27d8a0fa5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:02.205185 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b09e83fd-beb1-4ddd-9fbb-6bf27d8a0fa5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:02.205937 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b09e83fd-beb1-4ddd-9fbb-6bf27d8a0fa5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:02.206369 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b09e83fd-beb1-4ddd-9fbb-6bf27d8a0fa5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:02.338465 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b09e83fd-beb1-4ddd-9fbb-6bf27d8a0fa5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:51:02.346228 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b09e83fd-beb1-4ddd-9fbb-6bf27d8a0fa5 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1498 microversion: 2.1 time: 0.152314 Jul 20 11:51:02.349057 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 665/1341] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:51:02 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:51:03.412947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-a3a19af4-d9af-4b7f-b486-c48651aa2ad2 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:51:03.418058 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a3a19af4-d9af-4b7f-b486-c48651aa2ad2 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:51:03.420256 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a3a19af4-d9af-4b7f-b486-c48651aa2ad2 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:03.420848 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a3a19af4-d9af-4b7f-b486-c48651aa2ad2 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:03.421672 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a3a19af4-d9af-4b7f-b486-c48651aa2ad2 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:03.422102 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-a3a19af4-d9af-4b7f-b486-c48651aa2ad2 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:03.451119 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-a3a19af4-d9af-4b7f-b486-c48651aa2ad2 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:51:03.845888 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-a3a19af4-d9af-4b7f-b486-c48651aa2ad2 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "DELETE /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 204 len: 0 microversion: 2.1 time: 0.436836 Jul 20 11:51:03.846493 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 677/1342] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:51:03 2022] DELETE /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:51:03.855458 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6e160487-75a1-40b3-b8ca-e1dad30a406d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:51:03.856066 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-6e160487-75a1-40b3-b8ca-e1dad30a406d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:51:03.863086 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e160487-75a1-40b3-b8ca-e1dad30a406d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:03.863532 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e160487-75a1-40b3-b8ca-e1dad30a406d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:03.864403 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e160487-75a1-40b3-b8ca-e1dad30a406d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:03.864990 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-6e160487-75a1-40b3-b8ca-e1dad30a406d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:04.002324 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-6e160487-75a1-40b3-b8ca-e1dad30a406d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:51:04.010378 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6e160487-75a1-40b3-b8ca-e1dad30a406d tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1504 microversion: 2.1 time: 0.159132 Jul 20 11:51:04.010946 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 666/1343] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:51:03 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:51:05.028059 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-93d36f64-9845-4962-972f-1985312e4f5b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:51:05.028828 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-93d36f64-9845-4962-972f-1985312e4f5b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:51:05.035896 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93d36f64-9845-4962-972f-1985312e4f5b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:05.036335 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93d36f64-9845-4962-972f-1985312e4f5b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:05.037128 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93d36f64-9845-4962-972f-1985312e4f5b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:05.037557 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-93d36f64-9845-4962-972f-1985312e4f5b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:05.423023 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-93d36f64-9845-4962-972f-1985312e4f5b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:51:05.431091 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-93d36f64-9845-4962-972f-1985312e4f5b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1504 microversion: 2.1 time: 0.407304 Jul 20 11:51:05.431658 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 678/1344] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:51:05 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:51:06.447851 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-33e51309-dc61-4d2c-aa18-9584ed52ea54 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:51:06.448644 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-33e51309-dc61-4d2c-aa18-9584ed52ea54 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:51:06.455112 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33e51309-dc61-4d2c-aa18-9584ed52ea54 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:06.455553 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33e51309-dc61-4d2c-aa18-9584ed52ea54 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:06.456321 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33e51309-dc61-4d2c-aa18-9584ed52ea54 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:06.456751 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33e51309-dc61-4d2c-aa18-9584ed52ea54 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:06.518737 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-33e51309-dc61-4d2c-aa18-9584ed52ea54 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:51:06.528995 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-33e51309-dc61-4d2c-aa18-9584ed52ea54 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1462 microversion: 2.1 time: 0.082963 Jul 20 11:51:06.528995 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 679/1345] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:51:06 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:51:06.560264 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-e6146970-813c-4897-b960-18833bef9d26 req-ecc33e4f-6fc3-43aa-b90f-d8c9401a2e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ee2c3e-b90d-4462-876b-871f24655e53", "name": "network-vif-deleted", "tag": "570e097e-ab83-4fab-b3cc-b4caf9fe4420"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:51:06.563814 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:51:06.570142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-e6146970-813c-4897-b960-18833bef9d26 req-ecc33e4f-6fc3-43aa-b90f-d8c9401a2e47 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:06.570584 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-e6146970-813c-4897-b960-18833bef9d26 req-ecc33e4f-6fc3-43aa-b90f-d8c9401a2e47 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:06.581977 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-e6146970-813c-4897-b960-18833bef9d26 req-ecc33e4f-6fc3-43aa-b90f-d8c9401a2e47 service nova] Creating event network-vif-deleted:570e097e-ab83-4fab-b3cc-b4caf9fe4420 for instance 60ee2c3e-b90d-4462-876b-871f24655e53 on hv-cinder-82282 Jul 20 11:51:06.587564 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-e6146970-813c-4897-b960-18833bef9d26 req-ecc33e4f-6fc3-43aa-b90f-d8c9401a2e47 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156290 Jul 20 11:51:06.588160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 667/1346] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:51:07.544897 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5994325b-9142-46c7-a0bb-d5e9455e8ea7 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:51:07.545618 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5994325b-9142-46c7-a0bb-d5e9455e8ea7 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:51:07.547814 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:51:07.552596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5994325b-9142-46c7-a0bb-d5e9455e8ea7 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:07.553070 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5994325b-9142-46c7-a0bb-d5e9455e8ea7 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:07.553993 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5994325b-9142-46c7-a0bb-d5e9455e8ea7 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:07.554323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5994325b-9142-46c7-a0bb-d5e9455e8ea7 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:07.586650 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5994325b-9142-46c7-a0bb-d5e9455e8ea7 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:07.586999 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5994325b-9142-46c7-a0bb-d5e9455e8ea7 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:07.587445 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-5994325b-9142-46c7-a0bb-d5e9455e8ea7 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lazy-loading 'fault' on Instance uuid 60ee2c3e-b90d-4462-876b-871f24655e53 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:51:07.629066 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-5994325b-9142-46c7-a0bb-d5e9455e8ea7 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fca61a3bb8145d2aba5cecf37e870c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd929e5d1a40bf8073e26456a09684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:51:07.636972 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5994325b-9142-46c7-a0bb-d5e9455e8ea7 tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 200 len: 1304 microversion: 2.1 time: 0.096867 Jul 20 11:51:07.637577 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 680/1347] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:51:07 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:51:08.656195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7c3be828-2931-46bd-8181-f1964318af9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:51:08.656809 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7c3be828-2931-46bd-8181-f1964318af9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] [instance: 60ee2c3e-b90d-4462-876b-871f24655e53] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:51:08.663991 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c3be828-2931-46bd-8181-f1964318af9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:08.664428 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c3be828-2931-46bd-8181-f1964318af9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:08.665215 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c3be828-2931-46bd-8181-f1964318af9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:51:08.665644 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7c3be828-2931-46bd-8181-f1964318af9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:51:08.679137 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-7c3be828-2931-46bd-8181-f1964318af9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] HTTP exception thrown: Instance 60ee2c3e-b90d-4462-876b-871f24655e53 could not be found. Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7c3be828-2931-46bd-8181-f1964318af9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Request method failure captured: Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 HTTP/1.1 Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-vtzVTnCzPzRCfjZP8pyOEuvzdkFk3YHHQAurRPg4Vd-T8o2-SjQcu8T2E8G6SxeSVZPZzL49jvW8ya7hbx0w_3Tij0u_OLOFneAvp-qPtyjtE7Ex5EZCVSnjIifO6RXAjZz-8a5bsiG3iL02M4it7RD3OlD58iZeGjCEb-T6t8mWk Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: e4cd929e5d1a40bf8073e26456a09684 Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesActionsTest-1294114921 Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:51:08.680817 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:51:08.682514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e4cd929e5d1a40bf8073e26456a09684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e4cd929e5d1a40bf8073e26456a09684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e4cd929e5d1a40bf8073e26456a09684", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e4cd929e5d1a40bf8073e26456a09684"}]}] Jul 20 11:51:08.682514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesActionsTest-1294114921 Jul 20 11:51:08.682514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: e4cd929e5d1a40bf8073e26456a09684 Jul 20 11:51:08.682514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesActionsTest-1294114921 Jul 20 11:51:08.682514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesActionsTest-1294114921-project Jul 20 11:51:08.682514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:51:08.682514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:51:08.682514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 2fca61a3bb8145d2aba5cecf37e870c0 Jul 20 11:51:08.682514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesActionsTest-1294114921-project Jul 20 11:51:08.682514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:51:08.682514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance 60ee2c3e-b90d-4462-876b-871f24655e53 could not be found. Jul 20 11:51:08.682514 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': '60ee2c3e-b90d-4462-876b-871f24655e53'} Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60ee2c3e-b90d-4462-876b-871f24655e53 could not be found. Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:51:08.683548 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60ee2c3e-b90d-4462-876b-871f24655e53 could not be found. Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60ee2c3e-b90d-4462-876b-871f24655e53 could not be found. Jul 20 11:51:08.685352 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:51:08.687031 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7c3be828-2931-46bd-8181-f1964318af9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] Returning 404 to user: Instance 60ee2c3e-b90d-4462-876b-871f24655e53 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:51:08.687031 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7c3be828-2931-46bd-8181-f1964318af9b tempest-VolumesActionsTest-1294114921 tempest-VolumesActionsTest-1294114921-project] 10.222.0.43 "GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53" status: 404 len: 111 microversion: 2.1 time: 0.031125 Jul 20 11:51:08.687031 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 668/1348] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:51:08 2022] GET /compute/v2.1/servers/60ee2c3e-b90d-4462-876b-871f24655e53 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:52:13.083415 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:52:13.085410 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=60 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:52:13.088808 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f832fbb5-c13d-4bed-a60a-e769f8850f8a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:13.089271 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-883473ec-aca6-40c9-92c3-f9373d2e5fbf req-9a71eedb-86ab-4fbe-a3b5-b899fb6059aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50770e2b-c996-4781-8e9c-e8c732192d8f", "tag": "b54a0b8c-6f79-4235-a36e-80508962e271"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:52:13.089422 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f832fbb5-c13d-4bed-a60a-e769f8850f8a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:13.096161 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f832fbb5-c13d-4bed-a60a-e769f8850f8a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:13.096918 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f832fbb5-c13d-4bed-a60a-e769f8850f8a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:13.097495 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-883473ec-aca6-40c9-92c3-f9373d2e5fbf req-9a71eedb-86ab-4fbe-a3b5-b899fb6059aa service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:13.097934 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-883473ec-aca6-40c9-92c3-f9373d2e5fbf req-9a71eedb-86ab-4fbe-a3b5-b899fb6059aa service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:13.098260 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f832fbb5-c13d-4bed-a60a-e769f8850f8a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:13.098853 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f832fbb5-c13d-4bed-a60a-e769f8850f8a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:13.111268 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-883473ec-aca6-40c9-92c3-f9373d2e5fbf req-9a71eedb-86ab-4fbe-a3b5-b899fb6059aa service nova] Creating event network-changed:b54a0b8c-6f79-4235-a36e-80508962e271 for instance 50770e2b-c996-4781-8e9c-e8c732192d8f on hv-cinder-82282 Jul 20 11:52:13.117346 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-883473ec-aca6-40c9-92c3-f9373d2e5fbf req-9a71eedb-86ab-4fbe-a3b5-b899fb6059aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033661 Jul 20 11:52:13.117877 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 669/1349] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:52:13.133318 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f832fbb5-c13d-4bed-a60a-e769f8850f8a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:52:13.643932 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f832fbb5-c13d-4bed-a60a-e769f8850f8a tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "DELETE /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 204 len: 0 microversion: 2.1 time: 0.562421 Jul 20 11:52:13.644622 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 681/1350] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:52:13 2022] DELETE /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:52:13.653873 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b602cef9-f7f7-4b17-a8d6-66e7b4c6c6d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:13.654799 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b602cef9-f7f7-4b17-a8d6-66e7b4c6c6d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:13.663789 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b602cef9-f7f7-4b17-a8d6-66e7b4c6c6d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:13.664251 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b602cef9-f7f7-4b17-a8d6-66e7b4c6c6d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:13.665791 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b602cef9-f7f7-4b17-a8d6-66e7b4c6c6d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:13.666434 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b602cef9-f7f7-4b17-a8d6-66e7b4c6c6d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:13.819157 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-b602cef9-f7f7-4b17-a8d6-66e7b4c6c6d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:52:13.827533 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b602cef9-f7f7-4b17-a8d6-66e7b4c6c6d1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1577 microversion: 2.1 time: 0.178167 Jul 20 11:52:13.828119 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 670/1351] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:52:13 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:52:14.848259 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-cbfdefcf-0648-4f2b-b46c-7339dd050143 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:14.848982 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-cbfdefcf-0648-4f2b-b46c-7339dd050143 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:14.856947 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbfdefcf-0648-4f2b-b46c-7339dd050143 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:14.857387 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbfdefcf-0648-4f2b-b46c-7339dd050143 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:14.858174 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbfdefcf-0648-4f2b-b46c-7339dd050143 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:14.858607 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-cbfdefcf-0648-4f2b-b46c-7339dd050143 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:15.007812 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-cbfdefcf-0648-4f2b-b46c-7339dd050143 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:52:15.016206 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-cbfdefcf-0648-4f2b-b46c-7339dd050143 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1577 microversion: 2.1 time: 0.172190 Jul 20 11:52:15.016812 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 682/1352] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:52:14 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:52:16.033500 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-589032e5-ed88-4745-ad29-89021efb7c71 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:16.034106 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-589032e5-ed88-4745-ad29-89021efb7c71 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:16.041792 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-589032e5-ed88-4745-ad29-89021efb7c71 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:16.042254 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-589032e5-ed88-4745-ad29-89021efb7c71 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:16.043054 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-589032e5-ed88-4745-ad29-89021efb7c71 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:16.043483 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-589032e5-ed88-4745-ad29-89021efb7c71 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:16.189179 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-589032e5-ed88-4745-ad29-89021efb7c71 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:52:16.198017 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-589032e5-ed88-4745-ad29-89021efb7c71 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1459 microversion: 2.1 time: 0.168347 Jul 20 11:52:16.207660 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 671/1353] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:52:16 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1459 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:52:16.637374 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-4ee4b27d-9fa9-424b-8bb1-69e91d3bc92c req-714ec020-4c97-45ee-a3b4-5b5b4ed7bb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50770e2b-c996-4781-8e9c-e8c732192d8f", "name": "network-vif-deleted", "tag": "b54a0b8c-6f79-4235-a36e-80508962e271"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:52:16.646832 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-4ee4b27d-9fa9-424b-8bb1-69e91d3bc92c req-714ec020-4c97-45ee-a3b4-5b5b4ed7bb7e service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:16.647274 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-4ee4b27d-9fa9-424b-8bb1-69e91d3bc92c req-714ec020-4c97-45ee-a3b4-5b5b4ed7bb7e service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:16.664088 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-4ee4b27d-9fa9-424b-8bb1-69e91d3bc92c req-714ec020-4c97-45ee-a3b4-5b5b4ed7bb7e service nova] Creating event network-vif-deleted:b54a0b8c-6f79-4235-a36e-80508962e271 for instance 50770e2b-c996-4781-8e9c-e8c732192d8f on hv-cinder-82282 Jul 20 11:52:16.669714 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-4ee4b27d-9fa9-424b-8bb1-69e91d3bc92c req-714ec020-4c97-45ee-a3b4-5b5b4ed7bb7e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038060 Jul 20 11:52:16.670398 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 683/1354] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:52:17.215577 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-873f00b4-a5fc-4537-8817-c3ddbd899c48 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:17.216226 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-873f00b4-a5fc-4537-8817-c3ddbd899c48 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:17.224966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-873f00b4-a5fc-4537-8817-c3ddbd899c48 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:17.226151 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-873f00b4-a5fc-4537-8817-c3ddbd899c48 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:17.227196 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-873f00b4-a5fc-4537-8817-c3ddbd899c48 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:17.227626 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-873f00b4-a5fc-4537-8817-c3ddbd899c48 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:17.304952 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-873f00b4-a5fc-4537-8817-c3ddbd899c48 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:52:17.313801 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-873f00b4-a5fc-4537-8817-c3ddbd899c48 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 200 len: 1225 microversion: 2.1 time: 0.102435 Jul 20 11:52:17.314494 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 672/1355] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:52:17 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:52:18.332208 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6ce7fb09-5aac-4d8c-87a8-325aa4f259b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:18.332997 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-6ce7fb09-5aac-4d8c-87a8-325aa4f259b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 50770e2b-c996-4781-8e9c-e8c732192d8f] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:18.342507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ce7fb09-5aac-4d8c-87a8-325aa4f259b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:18.342507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ce7fb09-5aac-4d8c-87a8-325aa4f259b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:18.342507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ce7fb09-5aac-4d8c-87a8-325aa4f259b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:18.342507 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-6ce7fb09-5aac-4d8c-87a8-325aa4f259b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:18.355850 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-6ce7fb09-5aac-4d8c-87a8-325aa4f259b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] HTTP exception thrown: Instance 50770e2b-c996-4781-8e9c-e8c732192d8f could not be found. Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6ce7fb09-5aac-4d8c-87a8-325aa4f259b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Request method failure captured: Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f HTTP/1.1 Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-ouaF6WimIu4HzQ3E-PrHMRS7kUMsJPti6PyGbALmVaApXIvJ9xGerM4bkmgPyiI4kUuKs27URM0LaOu6ld6XDAduO9rJThwNeFsY3C97ft6U0_y_yOcBMEdW8_oXVUXWOiktW-p0xvAjAxo2TSCBm0wahFhAM5bgdaGWBhLB6K1M8 Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: fb6890ad12fa47eeb3cc29dbec41dbe2 Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:52:18.357608 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:52:18.359526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fb6890ad12fa47eeb3cc29dbec41dbe2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}] Jul 20 11:52:18.359526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:52:18.359526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: fb6890ad12fa47eeb3cc29dbec41dbe2 Jul 20 11:52:18.359526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:52:18.359526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-TestVolumeBootPattern-1794272804-project Jul 20 11:52:18.359526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:52:18.359526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:52:18.359526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: a32c5062f269416d9345c2ea2c6f85b6 Jul 20 11:52:18.359526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-TestVolumeBootPattern-1794272804-project Jul 20 11:52:18.359526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:52:18.359526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance 50770e2b-c996-4781-8e9c-e8c732192d8f could not be found. Jul 20 11:52:18.359526 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': '50770e2b-c996-4781-8e9c-e8c732192d8f'} Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50770e2b-c996-4781-8e9c-e8c732192d8f could not be found. Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:52:18.361045 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50770e2b-c996-4781-8e9c-e8c732192d8f could not be found. Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50770e2b-c996-4781-8e9c-e8c732192d8f could not be found. Jul 20 11:52:18.362883 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:18.364371 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-6ce7fb09-5aac-4d8c-87a8-325aa4f259b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Returning 404 to user: Instance 50770e2b-c996-4781-8e9c-e8c732192d8f could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:52:18.364371 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-6ce7fb09-5aac-4d8c-87a8-325aa4f259b1 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f" status: 404 len: 111 microversion: 2.1 time: 0.031643 Jul 20 11:52:18.364371 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 684/1356] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:52:18 2022] GET /compute/v2.1/servers/50770e2b-c996-4781-8e9c-e8c732192d8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:52:21.880043 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-e6ab1966-cc5a-4a4e-98b8-530f0f8f7467 req-eaef9d3f-0380-4790-a1b3-40670ba28006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a222c5a-9a05-425e-b301-8e79cdd760ce", "tag": "7b643c48-c2c5-421e-85ed-4923679b4e91"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:52:21.885064 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-cfb90c38-1342-4611-8036-3ea188cc2485 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:21.885592 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cfb90c38-1342-4611-8036-3ea188cc2485 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:21.890024 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e6ab1966-cc5a-4a4e-98b8-530f0f8f7467 req-eaef9d3f-0380-4790-a1b3-40670ba28006 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:21.890806 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-e6ab1966-cc5a-4a4e-98b8-530f0f8f7467 req-eaef9d3f-0380-4790-a1b3-40670ba28006 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:21.892348 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cfb90c38-1342-4611-8036-3ea188cc2485 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:21.892824 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cfb90c38-1342-4611-8036-3ea188cc2485 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:21.893598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cfb90c38-1342-4611-8036-3ea188cc2485 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:21.894248 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-cfb90c38-1342-4611-8036-3ea188cc2485 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:21.903321 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-e6ab1966-cc5a-4a4e-98b8-530f0f8f7467 req-eaef9d3f-0380-4790-a1b3-40670ba28006 service nova] Creating event network-changed:7b643c48-c2c5-421e-85ed-4923679b4e91 for instance 4a222c5a-9a05-425e-b301-8e79cdd760ce on hv-cinder-82282 Jul 20 11:52:21.908684 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-e6ab1966-cc5a-4a4e-98b8-530f0f8f7467 req-eaef9d3f-0380-4790-a1b3-40670ba28006 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032411 Jul 20 11:52:21.909827 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 685/1357] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:52:21.923071 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-cfb90c38-1342-4611-8036-3ea188cc2485 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Going to try to terminate instance {{(pid=124830) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:52:22.404243 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-cfb90c38-1342-4611-8036-3ea188cc2485 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 204 len: 0 microversion: 2.1 time: 0.529097 Jul 20 11:52:22.408721 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 673/1358] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:52:21 2022] DELETE /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:52:22.417775 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-bf761130-b31c-45ae-ae22-6432e097fb33 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:22.418490 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-bf761130-b31c-45ae-ae22-6432e097fb33 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:22.425127 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf761130-b31c-45ae-ae22-6432e097fb33 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:22.425660 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf761130-b31c-45ae-ae22-6432e097fb33 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:22.426589 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf761130-b31c-45ae-ae22-6432e097fb33 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:22.426996 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-bf761130-b31c-45ae-ae22-6432e097fb33 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:22.588852 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-bf761130-b31c-45ae-ae22-6432e097fb33 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:52:22.598835 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-bf761130-b31c-45ae-ae22-6432e097fb33 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1578 microversion: 2.1 time: 0.186523 Jul 20 11:52:22.599917 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 686/1359] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:52:22 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:52:23.622584 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-30016114-d5cd-4fa2-9132-36046d140e22 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:23.623475 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-30016114-d5cd-4fa2-9132-36046d140e22 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:23.634540 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30016114-d5cd-4fa2-9132-36046d140e22 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:23.637497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30016114-d5cd-4fa2-9132-36046d140e22 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:23.637497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30016114-d5cd-4fa2-9132-36046d140e22 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:23.637497 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-30016114-d5cd-4fa2-9132-36046d140e22 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:23.790472 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-30016114-d5cd-4fa2-9132-36046d140e22 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:52:23.798452 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-30016114-d5cd-4fa2-9132-36046d140e22 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1459 microversion: 2.1 time: 0.182130 Jul 20 11:52:23.799714 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 674/1360] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:52:23 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1459 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:52:23.935784 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [req-25c50a3d-a339-41d0-9133-68077f79550f req-dc2fb2b4-d642-447d-9732-78d78484e37f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a222c5a-9a05-425e-b301-8e79cdd760ce", "name": "network-vif-deleted", "tag": "7b643c48-c2c5-421e-85ed-4923679b4e91"}]} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:52:23.946462 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-25c50a3d-a339-41d0-9133-68077f79550f req-dc2fb2b4-d642-447d-9732-78d78484e37f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:23.946462 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [req-25c50a3d-a339-41d0-9133-68077f79550f req-dc2fb2b4-d642-447d-9732-78d78484e37f service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:23.971356 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.compute.server_external_events [req-25c50a3d-a339-41d0-9133-68077f79550f req-dc2fb2b4-d642-447d-9732-78d78484e37f service nova] Creating event network-vif-deleted:7b643c48-c2c5-421e-85ed-4923679b4e91 for instance 4a222c5a-9a05-425e-b301-8e79cdd760ce on hv-cinder-82282 Jul 20 11:52:23.976752 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [req-25c50a3d-a339-41d0-9133-68077f79550f req-dc2fb2b4-d642-447d-9732-78d78484e37f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045372 Jul 20 11:52:23.978060 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 687/1361] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:52:24.817618 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-1c2f903e-480d-43ed-bb84-d325435d20d2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:24.818772 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-1c2f903e-480d-43ed-bb84-d325435d20d2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:24.827447 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c2f903e-480d-43ed-bb84-d325435d20d2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:24.827889 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c2f903e-480d-43ed-bb84-d325435d20d2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:24.828672 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c2f903e-480d-43ed-bb84-d325435d20d2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:24.829134 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c2f903e-480d-43ed-bb84-d325435d20d2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:24.866720 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c2f903e-480d-43ed-bb84-d325435d20d2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:24.867289 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-1c2f903e-480d-43ed-bb84-d325435d20d2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:24.867627 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-1c2f903e-480d-43ed-bb84-d325435d20d2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lazy-loading 'fault' on Instance uuid 4a222c5a-9a05-425e-b301-8e79cdd760ce {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:52:24.912765 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-1c2f903e-480d-43ed-bb84-d325435d20d2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32c5062f269416d9345c2ea2c6f85b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6890ad12fa47eeb3cc29dbec41dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:52:24.921609 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-1c2f903e-480d-43ed-bb84-d325435d20d2 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 200 len: 1229 microversion: 2.1 time: 0.109529 Jul 20 11:52:24.922202 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 675/1362] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:52:24 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 1229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:52:25.942293 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1e35fb95-01de-48f0-a6d1-2e96b3546fbe tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:25.942998 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1e35fb95-01de-48f0-a6d1-2e96b3546fbe tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 4a222c5a-9a05-425e-b301-8e79cdd760ce] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:25.949654 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e35fb95-01de-48f0-a6d1-2e96b3546fbe tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:25.950105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e35fb95-01de-48f0-a6d1-2e96b3546fbe tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:25.950900 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e35fb95-01de-48f0-a6d1-2e96b3546fbe tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:25.951337 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1e35fb95-01de-48f0-a6d1-2e96b3546fbe tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:25.965400 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-1e35fb95-01de-48f0-a6d1-2e96b3546fbe tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] HTTP exception thrown: Instance 4a222c5a-9a05-425e-b301-8e79cdd760ce could not be found. Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1e35fb95-01de-48f0-a6d1-2e96b3546fbe tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Request method failure captured: Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce HTTP/1.1 Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-ouaF6WimIu4HzQ3E-PrHMRS7kUMsJPti6PyGbALmVaApXIvJ9xGerM4bkmgPyiI4kUuKs27URM0LaOu6ld6XDAduO9rJThwNeFsY3C97ft6U0_y_yOcBMEdW8_oXVUXWOiktW-p0xvAjAxo2TSCBm0wahFhAM5bgdaGWBhLB6K1M8 Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: fb6890ad12fa47eeb3cc29dbec41dbe2 Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:52:25.967056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:52:25.969545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fb6890ad12fa47eeb3cc29dbec41dbe2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}] Jul 20 11:52:25.969545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:52:25.969545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: fb6890ad12fa47eeb3cc29dbec41dbe2 Jul 20 11:52:25.969545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:52:25.969545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-TestVolumeBootPattern-1794272804-project Jul 20 11:52:25.969545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:52:25.969545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:52:25.969545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: a32c5062f269416d9345c2ea2c6f85b6 Jul 20 11:52:25.969545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-TestVolumeBootPattern-1794272804-project Jul 20 11:52:25.969545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:52:25.969545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance 4a222c5a-9a05-425e-b301-8e79cdd760ce could not be found. Jul 20 11:52:25.969545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': '4a222c5a-9a05-425e-b301-8e79cdd760ce'} Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a222c5a-9a05-425e-b301-8e79cdd760ce could not be found. Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:52:25.970878 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a222c5a-9a05-425e-b301-8e79cdd760ce could not be found. Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a222c5a-9a05-425e-b301-8e79cdd760ce could not be found. Jul 20 11:52:25.972884 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:25.975116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1e35fb95-01de-48f0-a6d1-2e96b3546fbe tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Returning 404 to user: Instance 4a222c5a-9a05-425e-b301-8e79cdd760ce could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:52:25.975116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1e35fb95-01de-48f0-a6d1-2e96b3546fbe tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce" status: 404 len: 111 microversion: 2.1 time: 0.030876 Jul 20 11:52:25.975116 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 688/1363] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:52:25 2022] GET /compute/v2.1/servers/4a222c5a-9a05-425e-b301-8e79cdd760ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:52:26.567939 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b8db2dfc-32f1-4929-a161-ba80adbc61f8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:26.568528 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b8db2dfc-32f1-4929-a161-ba80adbc61f8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:26.575697 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8db2dfc-32f1-4929-a161-ba80adbc61f8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:26.576173 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8db2dfc-32f1-4929-a161-ba80adbc61f8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:26.588508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8db2dfc-32f1-4929-a161-ba80adbc61f8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:26.588508 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b8db2dfc-32f1-4929-a161-ba80adbc61f8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:26.594369 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-b8db2dfc-32f1-4929-a161-ba80adbc61f8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] HTTP exception thrown: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b8db2dfc-32f1-4929-a161-ba80adbc61f8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Request method failure captured: Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b HTTP/1.1 Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-ouaF6WimIu4HzQ3E-PrHMRS7kUMsJPti6PyGbALmVaApXIvJ9xGerM4bkmgPyiI4kUuKs27URM0LaOu6ld6XDAduO9rJThwNeFsY3C97ft6U0_y_yOcBMEdW8_oXVUXWOiktW-p0xvAjAxo2TSCBm0wahFhAM5bgdaGWBhLB6K1M8 Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: fb6890ad12fa47eeb3cc29dbec41dbe2 Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:52:26.596040 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:52:26.597964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fb6890ad12fa47eeb3cc29dbec41dbe2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}] Jul 20 11:52:26.597964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:52:26.597964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: fb6890ad12fa47eeb3cc29dbec41dbe2 Jul 20 11:52:26.597964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:52:26.597964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-TestVolumeBootPattern-1794272804-project Jul 20 11:52:26.597964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:52:26.597964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:52:26.597964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: a32c5062f269416d9345c2ea2c6f85b6 Jul 20 11:52:26.597964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-TestVolumeBootPattern-1794272804-project Jul 20 11:52:26.597964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:52:26.597964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:52:26.597964 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': '9c040895-6702-44a4-9b5f-db96396f225b'} Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:52:26.599073 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:52:26.600892 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:52:26.602840 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b8db2dfc-32f1-4929-a161-ba80adbc61f8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Returning 404 to user: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:52:26.602840 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b8db2dfc-32f1-4929-a161-ba80adbc61f8 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 404 len: 111 microversion: 2.1 time: 0.033542 Jul 20 11:52:26.602840 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 676/1364] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:52:26 2022] DELETE /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:52:26.606154 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5dcacd44-8239-44dc-89e0-4dbe2125cd66 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:26.606785 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5dcacd44-8239-44dc-89e0-4dbe2125cd66 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] [instance: 9c040895-6702-44a4-9b5f-db96396f225b] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:26.615214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dcacd44-8239-44dc-89e0-4dbe2125cd66 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:26.615214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dcacd44-8239-44dc-89e0-4dbe2125cd66 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:26.615214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dcacd44-8239-44dc-89e0-4dbe2125cd66 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:26.615214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5dcacd44-8239-44dc-89e0-4dbe2125cd66 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:26.629892 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-5dcacd44-8239-44dc-89e0-4dbe2125cd66 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] HTTP exception thrown: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5dcacd44-8239-44dc-89e0-4dbe2125cd66 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Request method failure captured: Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b HTTP/1.1 Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-ouaF6WimIu4HzQ3E-PrHMRS7kUMsJPti6PyGbALmVaApXIvJ9xGerM4bkmgPyiI4kUuKs27URM0LaOu6ld6XDAduO9rJThwNeFsY3C97ft6U0_y_yOcBMEdW8_oXVUXWOiktW-p0xvAjAxo2TSCBm0wahFhAM5bgdaGWBhLB6K1M8 Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: fb6890ad12fa47eeb3cc29dbec41dbe2 Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:52:26.631495 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:52:26.633831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fb6890ad12fa47eeb3cc29dbec41dbe2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fb6890ad12fa47eeb3cc29dbec41dbe2"}]}] Jul 20 11:52:26.633831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:52:26.633831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: fb6890ad12fa47eeb3cc29dbec41dbe2 Jul 20 11:52:26.633831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-TestVolumeBootPattern-1794272804 Jul 20 11:52:26.633831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-TestVolumeBootPattern-1794272804-project Jul 20 11:52:26.633831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:52:26.633831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:52:26.633831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: a32c5062f269416d9345c2ea2c6f85b6 Jul 20 11:52:26.633831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-TestVolumeBootPattern-1794272804-project Jul 20 11:52:26.633831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:52:26.633831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:52:26.633831 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': '9c040895-6702-44a4-9b5f-db96396f225b'} Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:52:26.634811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. Jul 20 11:52:26.636303 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:52:26.637689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5dcacd44-8239-44dc-89e0-4dbe2125cd66 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Returning 404 to user: Instance 9c040895-6702-44a4-9b5f-db96396f225b could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:52:26.637689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5dcacd44-8239-44dc-89e0-4dbe2125cd66 tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b" status: 404 len: 111 microversion: 2.1 time: 0.030581 Jul 20 11:52:26.637689 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 689/1365] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:52:26 2022] GET /compute/v2.1/servers/9c040895-6702-44a4-9b5f-db96396f225b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:52:28.305163 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-81b78de1-5d69-42db-8922-fe986428d6ba tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] Calling method '.version_select at 0x7f44e3867af0>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:28.416155 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-81b78de1-5d69-42db-8922-fe986428d6ba tempest-TestVolumeBootPattern-1794272804 tempest-TestVolumeBootPattern-1794272804-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-443586517" status: 202 len: 0 microversion: 2.1 time: 0.112262 Jul 20 11:52:28.416759 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 677/1366] 10.222.0.43 () {58 vars in 1259 bytes} [Wed Jul 20 11:52:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-443586517 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:52:30.196950 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-33675582-b00c-4359-b9f9-40cac5c80f23 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:30.197574 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-33675582-b00c-4359-b9f9-40cac5c80f23 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:30.204284 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33675582-b00c-4359-b9f9-40cac5c80f23 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:30.204895 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33675582-b00c-4359-b9f9-40cac5c80f23 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:30.205890 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33675582-b00c-4359-b9f9-40cac5c80f23 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:30.206565 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-33675582-b00c-4359-b9f9-40cac5c80f23 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:30.233571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-33675582-b00c-4359-b9f9-40cac5c80f23 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/ips" status: 200 len: 144 microversion: 2.1 time: 0.038879 Jul 20 11:52:30.236859 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 690/1367] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 11:52:30 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/ips => generated 144 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:52:33.347129 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-b95868e1-8f25-448d-9258-45de4e6d93a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e94b8698-387c-4e67-93d4-203588e3dfde"}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:52:33.348195 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-b95868e1-8f25-448d-9258-45de4e6d93a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:33.355908 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b95868e1-8f25-448d-9258-45de4e6d93a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:33.356358 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b95868e1-8f25-448d-9258-45de4e6d93a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:33.357173 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b95868e1-8f25-448d-9258-45de4e6d93a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:33.357614 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-b95868e1-8f25-448d-9258-45de4e6d93a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:34.695354 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-b95868e1-8f25-448d-9258-45de4e6d93a9 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "POST /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.352480 Jul 20 11:52:34.696179 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 678/1368] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:52:33 2022] POST /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments => generated 194 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:52:43.311513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-5486a025-2146-40ba-8de9-480076d568a5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:43.312440 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-5486a025-2146-40ba-8de9-480076d568a5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:43.314943 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:52:43.315596 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG dbcounter [-] [124831] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:52:43.320716 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5486a025-2146-40ba-8de9-480076d568a5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:43.326418 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5486a025-2146-40ba-8de9-480076d568a5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:43.326418 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5486a025-2146-40ba-8de9-480076d568a5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:43.326418 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-5486a025-2146-40ba-8de9-480076d568a5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:43.354439 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-5486a025-2146-40ba-8de9-480076d568a5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046870 Jul 20 11:52:43.354997 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 691/1369] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:52:43 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:52:43.365427 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-10f6c785-9904-4564-ba73-aef61464ff08 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:43.366004 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-10f6c785-9904-4564-ba73-aef61464ff08 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:43.369031 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:52:43.374212 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10f6c785-9904-4564-ba73-aef61464ff08 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:43.374653 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10f6c785-9904-4564-ba73-aef61464ff08 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:43.375432 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10f6c785-9904-4564-ba73-aef61464ff08 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:43.375865 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-10f6c785-9904-4564-ba73-aef61464ff08 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:43.407472 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-10f6c785-9904-4564-ba73-aef61464ff08 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments/e94b8698-387c-4e67-93d4-203588e3dfde" status: 200 len: 194 microversion: 2.1 time: 0.046258 Jul 20 11:52:43.408087 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 679/1370] 10.222.0.43 () {58 vars in 1412 bytes} [Wed Jul 20 11:52:43 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments/e94b8698-387c-4e67-93d4-203588e3dfde => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:52:46.252143 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9843ac1e-3a0f-4dc8-a875-4162812fb47d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7770d122-b02c-40b0-b06b-0320fe012d6d"}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:52:46.253223 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9843ac1e-3a0f-4dc8-a875-4162812fb47d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:46.261273 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9843ac1e-3a0f-4dc8-a875-4162812fb47d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:46.261719 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9843ac1e-3a0f-4dc8-a875-4162812fb47d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:46.262554 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9843ac1e-3a0f-4dc8-a875-4162812fb47d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:46.262911 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9843ac1e-3a0f-4dc8-a875-4162812fb47d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:47.353830 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9843ac1e-3a0f-4dc8-a875-4162812fb47d tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "POST /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.104817 Jul 20 11:52:47.354648 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 692/1371] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 11:52:46 2022] POST /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments => generated 194 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:52:55.916938 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-7f7e29ae-543b-4d97-8cf7-c5ab0af8e5fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:55.917972 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-7f7e29ae-543b-4d97-8cf7-c5ab0af8e5fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:55.920405 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG dbcounter [-] [124830] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:52:55.925720 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f7e29ae-543b-4d97-8cf7-c5ab0af8e5fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:55.926169 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f7e29ae-543b-4d97-8cf7-c5ab0af8e5fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:55.926945 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f7e29ae-543b-4d97-8cf7-c5ab0af8e5fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:55.927380 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-7f7e29ae-543b-4d97-8cf7-c5ab0af8e5fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:55.959043 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-7f7e29ae-543b-4d97-8cf7-c5ab0af8e5fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046496 Jul 20 11:52:55.959623 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 680/1372] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:52:55 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:52:56.109632 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-eb359052-7658-4c73-8ad3-fe14f3018038 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:56.110297 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-eb359052-7658-4c73-8ad3-fe14f3018038 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:56.117266 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb359052-7658-4c73-8ad3-fe14f3018038 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:56.117705 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb359052-7658-4c73-8ad3-fe14f3018038 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:56.118479 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb359052-7658-4c73-8ad3-fe14f3018038 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:56.118912 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-eb359052-7658-4c73-8ad3-fe14f3018038 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:56.150826 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-eb359052-7658-4c73-8ad3-fe14f3018038 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments/e94b8698-387c-4e67-93d4-203588e3dfde" status: 200 len: 194 microversion: 2.1 time: 0.046187 Jul 20 11:52:56.151504 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 693/1373] 10.222.0.43 () {58 vars in 1412 bytes} [Wed Jul 20 11:52:56 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments/e94b8698-387c-4e67-93d4-203588e3dfde => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:52:56.161867 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-70c5aaef-c341-4a2e-a3dd-dcb91c3d03fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:56.162359 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-70c5aaef-c341-4a2e-a3dd-dcb91c3d03fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:56.169076 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70c5aaef-c341-4a2e-a3dd-dcb91c3d03fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:56.169522 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70c5aaef-c341-4a2e-a3dd-dcb91c3d03fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:56.170292 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70c5aaef-c341-4a2e-a3dd-dcb91c3d03fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:56.170722 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-70c5aaef-c341-4a2e-a3dd-dcb91c3d03fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:56.259390 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-70c5aaef-c341-4a2e-a3dd-dcb91c3d03fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lazy-loading 'services' on Instance uuid 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:52:56.577355 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-70c5aaef-c341-4a2e-a3dd-dcb91c3d03fb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments/e94b8698-387c-4e67-93d4-203588e3dfde" status: 202 len: 0 microversion: 2.1 time: 0.419374 Jul 20 11:52:56.578061 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 681/1374] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 11:52:56 2022] DELETE /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments/e94b8698-387c-4e67-93d4-203588e3dfde => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:52:58.777316 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-4f53a4a4-8089-4351-93b5-308854737177 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:58.778199 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-4f53a4a4-8089-4351-93b5-308854737177 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:58.787916 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f53a4a4-8089-4351-93b5-308854737177 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:58.788362 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f53a4a4-8089-4351-93b5-308854737177 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:58.789178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f53a4a4-8089-4351-93b5-308854737177 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:58.789620 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-4f53a4a4-8089-4351-93b5-308854737177 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:58.819219 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-4f53a4a4-8089-4351-93b5-308854737177 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments/7770d122-b02c-40b0-b06b-0320fe012d6d" status: 200 len: 194 microversion: 2.1 time: 0.046600 Jul 20 11:52:58.819828 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 694/1375] 10.222.0.43 () {58 vars in 1412 bytes} [Wed Jul 20 11:52:58 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments/7770d122-b02c-40b0-b06b-0320fe012d6d => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:52:58.833386 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-14a0b808-02db-4721-82f7-4598403e2830 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:52:58.833993 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-14a0b808-02db-4721-82f7-4598403e2830 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:52:58.841278 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14a0b808-02db-4721-82f7-4598403e2830 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:58.842323 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14a0b808-02db-4721-82f7-4598403e2830 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:58.842504 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14a0b808-02db-4721-82f7-4598403e2830 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:52:58.842933 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-14a0b808-02db-4721-82f7-4598403e2830 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:52:58.934225 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.objects.instance [None req-14a0b808-02db-4721-82f7-4598403e2830 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lazy-loading 'services' on Instance uuid 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 {{(pid=124830) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:52:59.246458 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-14a0b808-02db-4721-82f7-4598403e2830 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments/7770d122-b02c-40b0-b06b-0320fe012d6d" status: 202 len: 0 microversion: 2.1 time: 0.418460 Jul 20 11:52:59.247341 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 682/1376] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 11:52:58 2022] DELETE /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments/7770d122-b02c-40b0-b06b-0320fe012d6d => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:53:01.471148 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8854bab3-5c17-4605-bdd2-edca355274cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:01.472150 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8854bab3-5c17-4605-bdd2-edca355274cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:53:01.479323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8854bab3-5c17-4605-bdd2-edca355274cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:01.479785 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8854bab3-5c17-4605-bdd2-edca355274cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:01.480571 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8854bab3-5c17-4605-bdd2-edca355274cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:01.481048 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8854bab3-5c17-4605-bdd2-edca355274cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:01.524594 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8854bab3-5c17-4605-bdd2-edca355274cb tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057382 Jul 20 11:53:01.525195 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 695/1377] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:53:01 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:53:01.649624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-62ee03f7-f363-496b-8085-7fcb477d3189 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:01.650645 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-62ee03f7-f363-496b-8085-7fcb477d3189 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:53:01.658101 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62ee03f7-f363-496b-8085-7fcb477d3189 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:01.658554 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62ee03f7-f363-496b-8085-7fcb477d3189 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:01.659342 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62ee03f7-f363-496b-8085-7fcb477d3189 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:01.659796 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-62ee03f7-f363-496b-8085-7fcb477d3189 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:01.693523 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-62ee03f7-f363-496b-8085-7fcb477d3189 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048716 Jul 20 11:53:01.694193 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 683/1378] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 11:53:01 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:53:01.775629 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-f3a11226-c14d-486e-8053-5b7ea6ceb805 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:01.777124 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f3a11226-c14d-486e-8053-5b7ea6ceb805 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:53:01.784390 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3a11226-c14d-486e-8053-5b7ea6ceb805 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:01.785063 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3a11226-c14d-486e-8053-5b7ea6ceb805 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:01.786573 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3a11226-c14d-486e-8053-5b7ea6ceb805 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:01.787129 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-f3a11226-c14d-486e-8053-5b7ea6ceb805 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:01.819004 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-f3a11226-c14d-486e-8053-5b7ea6ceb805 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Going to try to terminate instance {{(pid=124831) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:53:02.205294 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-f3a11226-c14d-486e-8053-5b7ea6ceb805 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 204 len: 0 microversion: 2.1 time: 0.434062 Jul 20 11:53:02.205960 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 696/1379] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:53:01 2022] DELETE /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:53:02.214865 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c7238c2f-00c9-4fd9-b7be-1cafd821ea76 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:02.215482 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c7238c2f-00c9-4fd9-b7be-1cafd821ea76 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:53:02.221721 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7238c2f-00c9-4fd9-b7be-1cafd821ea76 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:02.222171 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7238c2f-00c9-4fd9-b7be-1cafd821ea76 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:02.222942 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7238c2f-00c9-4fd9-b7be-1cafd821ea76 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:02.223368 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c7238c2f-00c9-4fd9-b7be-1cafd821ea76 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:02.366512 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-c7238c2f-00c9-4fd9-b7be-1cafd821ea76 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:53:02.379176 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c7238c2f-00c9-4fd9-b7be-1cafd821ea76 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1671 microversion: 2.1 time: 0.164012 Jul 20 11:53:02.379176 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 684/1380] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:53:02 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:53:03.392345 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-af1c488e-a676-4941-9409-646c30735ac5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:03.393075 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-af1c488e-a676-4941-9409-646c30735ac5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:53:03.399654 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af1c488e-a676-4941-9409-646c30735ac5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:03.400101 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af1c488e-a676-4941-9409-646c30735ac5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:03.400913 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af1c488e-a676-4941-9409-646c30735ac5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:03.401800 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-af1c488e-a676-4941-9409-646c30735ac5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:03.545573 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-af1c488e-a676-4941-9409-646c30735ac5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:53:03.554500 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-af1c488e-a676-4941-9409-646c30735ac5 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1671 microversion: 2.1 time: 0.166350 Jul 20 11:53:03.555084 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 697/1381] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:53:03 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:53:04.572749 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-077e53d1-650a-4190-b0cb-b259315004e7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:04.574116 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-077e53d1-650a-4190-b0cb-b259315004e7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:53:04.581248 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-077e53d1-650a-4190-b0cb-b259315004e7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:04.581692 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-077e53d1-650a-4190-b0cb-b259315004e7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:04.582448 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-077e53d1-650a-4190-b0cb-b259315004e7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:04.582873 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-077e53d1-650a-4190-b0cb-b259315004e7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:04.716457 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.policy [None req-077e53d1-650a-4190-b0cb-b259315004e7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124830) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:53:04.725042 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-077e53d1-650a-4190-b0cb-b259315004e7 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1671 microversion: 2.1 time: 0.155607 Jul 20 11:53:04.728926 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 685/1382] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:53:04 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:53:05.743225 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-224eeb8f-88d6-465f-88c1-d2cdfdb6a648 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:05.744634 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-224eeb8f-88d6-465f-88c1-d2cdfdb6a648 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:53:05.753980 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-224eeb8f-88d6-465f-88c1-d2cdfdb6a648 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:05.754855 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-224eeb8f-88d6-465f-88c1-d2cdfdb6a648 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:05.761730 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-224eeb8f-88d6-465f-88c1-d2cdfdb6a648 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:05.763502 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-224eeb8f-88d6-465f-88c1-d2cdfdb6a648 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:05.860984 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-224eeb8f-88d6-465f-88c1-d2cdfdb6a648 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:53:05.873308 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-224eeb8f-88d6-465f-88c1-d2cdfdb6a648 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1604 microversion: 2.1 time: 0.135001 Jul 20 11:53:05.874228 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 698/1383] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:53:05 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1604 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:53:05.983728 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [req-8bc432e4-52eb-40f1-9a3a-3f383d90ceac req-efdf43b4-c906-44d2-9cb3-9e6b1e623015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9e27b9-9125-4eb4-adcd-de1f576d0f95", "name": "network-vif-deleted", "tag": "d2551346-d102-4572-aedc-59c2a295d4c3"}]} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:53:05.993410 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-8bc432e4-52eb-40f1-9a3a-3f383d90ceac req-efdf43b4-c906-44d2-9cb3-9e6b1e623015 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:05.996159 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [req-8bc432e4-52eb-40f1-9a3a-3f383d90ceac req-efdf43b4-c906-44d2-9cb3-9e6b1e623015 service nova] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:06.005658 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.compute.server_external_events [req-8bc432e4-52eb-40f1-9a3a-3f383d90ceac req-efdf43b4-c906-44d2-9cb3-9e6b1e623015 service nova] Creating event network-vif-deleted:d2551346-d102-4572-aedc-59c2a295d4c3 for instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 on hv-cinder-82282 Jul 20 11:53:06.015322 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [req-8bc432e4-52eb-40f1-9a3a-3f383d90ceac req-efdf43b4-c906-44d2-9cb3-9e6b1e623015 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037598 Jul 20 11:53:06.016150 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 686/1384] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 11:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:53:06.892182 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-9df91948-90cc-43bc-b692-239007c39af6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:06.893673 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-9df91948-90cc-43bc-b692-239007c39af6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:53:06.900180 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9df91948-90cc-43bc-b692-239007c39af6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:06.900625 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9df91948-90cc-43bc-b692-239007c39af6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:06.901576 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9df91948-90cc-43bc-b692-239007c39af6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:06.902016 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9df91948-90cc-43bc-b692-239007c39af6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:06.938888 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9df91948-90cc-43bc-b692-239007c39af6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:06.939835 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-9df91948-90cc-43bc-b692-239007c39af6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:06.939835 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.objects.instance [None req-9df91948-90cc-43bc-b692-239007c39af6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lazy-loading 'fault' on Instance uuid 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 {{(pid=124831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:53:06.990316 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.policy [None req-9df91948-90cc-43bc-b692-239007c39af6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961ac5eb91a2432d971f4622620e4e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb934ac079d4a428bea92620e05280f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124831) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:53:06.998590 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-9df91948-90cc-43bc-b692-239007c39af6 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 200 len: 1327 microversion: 2.1 time: 0.111116 Jul 20 11:53:06.999833 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 699/1385] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:53:06 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:53:08.017333 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c2bb93cc-02d4-4fad-a8a0-16d6817c5070 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:08.018025 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-c2bb93cc-02d4-4fad-a8a0-16d6817c5070 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:53:08.024744 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2bb93cc-02d4-4fad-a8a0-16d6817c5070 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:08.025220 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2bb93cc-02d4-4fad-a8a0-16d6817c5070 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:08.025987 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2bb93cc-02d4-4fad-a8a0-16d6817c5070 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:08.026421 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-c2bb93cc-02d4-4fad-a8a0-16d6817c5070 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:08.039965 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-c2bb93cc-02d4-4fad-a8a0-16d6817c5070 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] HTTP exception thrown: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c2bb93cc-02d4-4fad-a8a0-16d6817c5070 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Request method failure captured: Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 HTTP/1.1 Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-qaHs9ytbd3SDhbSUdhK9F76xxklEv1QTm_5pby9z9PixG8gtwZyB8qkx_58-MYxgiimAGs_UJoTa3jTXBk6dfObJ3QVZq37dNVY8v0VRoQbbFkO5rsWlCM5g0i7LEEglQvoY31DfpuxLDcPsLPVZL-uqFMI9llEz6BgMRKcyftrRQ Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: 0eb934ac079d4a428bea92620e05280f Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:53:08.041599 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:53:08.043499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0eb934ac079d4a428bea92620e05280f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0eb934ac079d4a428bea92620e05280f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0eb934ac079d4a428bea92620e05280f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0eb934ac079d4a428bea92620e05280f"}]}] Jul 20 11:53:08.043499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:08.043499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 0eb934ac079d4a428bea92620e05280f Jul 20 11:53:08.043499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:08.043499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeTestJSON-1988218754-project Jul 20 11:53:08.043499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:53:08.043499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:53:08.043499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 961ac5eb91a2432d971f4622620e4e1c Jul 20 11:53:08.043499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeTestJSON-1988218754-project Jul 20 11:53:08.043499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:53:08.043499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:08.043499 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': '5c9e27b9-9125-4eb4-adcd-de1f576d0f95'} Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:53:08.044811 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:08.046860 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:08.048443 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-c2bb93cc-02d4-4fad-a8a0-16d6817c5070 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Returning 404 to user: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:53:08.048443 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-c2bb93cc-02d4-4fad-a8a0-16d6817c5070 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 404 len: 111 microversion: 2.1 time: 0.029977 Jul 20 11:53:08.048443 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 687/1386] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:53:08 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:53:08.051937 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-65bc4975-bca5-4d60-a50b-88fba65b7b51 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '.version_select at 0x7f44e38ef3a0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:08.140505 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-65bc4975-bca5-4d60-a50b-88fba65b7b51 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1773846466" status: 202 len: 0 microversion: 2.1 time: 0.092219 Jul 20 11:53:08.141162 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 700/1387] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jul 20 11:53:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1773846466 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:53:11.525571 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-168e9fda-3ba5-4abc-b5b3-fa19ff220370 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:11.526749 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-168e9fda-3ba5-4abc-b5b3-fa19ff220370 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:53:11.542286 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-168e9fda-3ba5-4abc-b5b3-fa19ff220370 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:11.542794 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-168e9fda-3ba5-4abc-b5b3-fa19ff220370 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:11.544036 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-168e9fda-3ba5-4abc-b5b3-fa19ff220370 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:11.544972 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-168e9fda-3ba5-4abc-b5b3-fa19ff220370 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:11.563669 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-168e9fda-3ba5-4abc-b5b3-fa19ff220370 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] HTTP exception thrown: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-168e9fda-3ba5-4abc-b5b3-fa19ff220370 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Request method failure captured: Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 HTTP/1.1 Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-qaHs9ytbd3SDhbSUdhK9F76xxklEv1QTm_5pby9z9PixG8gtwZyB8qkx_58-MYxgiimAGs_UJoTa3jTXBk6dfObJ3QVZq37dNVY8v0VRoQbbFkO5rsWlCM5g0i7LEEglQvoY31DfpuxLDcPsLPVZL-uqFMI9llEz6BgMRKcyftrRQ Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: 0eb934ac079d4a428bea92620e05280f Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:53:11.565246 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:53:11.567032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0eb934ac079d4a428bea92620e05280f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0eb934ac079d4a428bea92620e05280f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0eb934ac079d4a428bea92620e05280f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0eb934ac079d4a428bea92620e05280f"}]}] Jul 20 11:53:11.567032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:11.567032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 0eb934ac079d4a428bea92620e05280f Jul 20 11:53:11.567032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:11.567032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeTestJSON-1988218754-project Jul 20 11:53:11.567032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:53:11.567032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:53:11.567032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 961ac5eb91a2432d971f4622620e4e1c Jul 20 11:53:11.567032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeTestJSON-1988218754-project Jul 20 11:53:11.567032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:53:11.567032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:11.567032 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': '5c9e27b9-9125-4eb4-adcd-de1f576d0f95'} Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:53:11.567958 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:11.570408 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:11.571993 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-168e9fda-3ba5-4abc-b5b3-fa19ff220370 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Returning 404 to user: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:53:11.571993 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-168e9fda-3ba5-4abc-b5b3-fa19ff220370 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 404 len: 111 microversion: 2.1 time: 0.044918 Jul 20 11:53:11.571993 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 688/1388] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:53:11 2022] DELETE /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:53:11.576060 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8e25cc29-a4d4-4bbe-8f16-592786ec73c4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:11.576702 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-8e25cc29-a4d4-4bbe-8f16-592786ec73c4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: 5c9e27b9-9125-4eb4-adcd-de1f576d0f95] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:53:11.584228 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e25cc29-a4d4-4bbe-8f16-592786ec73c4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:11.584676 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e25cc29-a4d4-4bbe-8f16-592786ec73c4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:11.585469 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e25cc29-a4d4-4bbe-8f16-592786ec73c4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:11.585901 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-8e25cc29-a4d4-4bbe-8f16-592786ec73c4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:11.601545 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-8e25cc29-a4d4-4bbe-8f16-592786ec73c4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] HTTP exception thrown: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8e25cc29-a4d4-4bbe-8f16-592786ec73c4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Request method failure captured: Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 HTTP/1.1 Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-qaHs9ytbd3SDhbSUdhK9F76xxklEv1QTm_5pby9z9PixG8gtwZyB8qkx_58-MYxgiimAGs_UJoTa3jTXBk6dfObJ3QVZq37dNVY8v0VRoQbbFkO5rsWlCM5g0i7LEEglQvoY31DfpuxLDcPsLPVZL-uqFMI9llEz6BgMRKcyftrRQ Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: 0eb934ac079d4a428bea92620e05280f Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:53:11.603178 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:53:11.605473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0eb934ac079d4a428bea92620e05280f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0eb934ac079d4a428bea92620e05280f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0eb934ac079d4a428bea92620e05280f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0eb934ac079d4a428bea92620e05280f"}]}] Jul 20 11:53:11.605473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:11.605473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 0eb934ac079d4a428bea92620e05280f Jul 20 11:53:11.605473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:11.605473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeTestJSON-1988218754-project Jul 20 11:53:11.605473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:53:11.605473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:53:11.605473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 961ac5eb91a2432d971f4622620e4e1c Jul 20 11:53:11.605473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeTestJSON-1988218754-project Jul 20 11:53:11.605473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:53:11.605473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:11.605473 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': '5c9e27b9-9125-4eb4-adcd-de1f576d0f95'} Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:53:11.606482 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. Jul 20 11:53:11.608458 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:11.610106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8e25cc29-a4d4-4bbe-8f16-592786ec73c4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Returning 404 to user: Instance 5c9e27b9-9125-4eb4-adcd-de1f576d0f95 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:53:11.610106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8e25cc29-a4d4-4bbe-8f16-592786ec73c4 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95" status: 404 len: 111 microversion: 2.1 time: 0.032866 Jul 20 11:53:11.610106 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 701/1389] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:53:11 2022] GET /compute/v2.1/servers/5c9e27b9-9125-4eb4-adcd-de1f576d0f95 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:53:12.952447 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0e331d86-02a6-4dea-a483-fcc0e12413de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:12.953031 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.compute.api [None req-0e331d86-02a6-4dea-a483-fcc0e12413de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124830) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:53:12.959583 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e331d86-02a6-4dea-a483-fcc0e12413de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:12.960033 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e331d86-02a6-4dea-a483-fcc0e12413de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:12.960833 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e331d86-02a6-4dea-a483-fcc0e12413de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:12.961274 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG oslo_concurrency.lockutils [None req-0e331d86-02a6-4dea-a483-fcc0e12413de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:12.975781 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-0e331d86-02a6-4dea-a483-fcc0e12413de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] HTTP exception thrown: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0e331d86-02a6-4dea-a483-fcc0e12413de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Request method failure captured: Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 HTTP/1.1 Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-qaHs9ytbd3SDhbSUdhK9F76xxklEv1QTm_5pby9z9PixG8gtwZyB8qkx_58-MYxgiimAGs_UJoTa3jTXBk6dfObJ3QVZq37dNVY8v0VRoQbbFkO5rsWlCM5g0i7LEEglQvoY31DfpuxLDcPsLPVZL-uqFMI9llEz6BgMRKcyftrRQ Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: 0eb934ac079d4a428bea92620e05280f Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:53:12.980966 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:53:12.982747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0eb934ac079d4a428bea92620e05280f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0eb934ac079d4a428bea92620e05280f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0eb934ac079d4a428bea92620e05280f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0eb934ac079d4a428bea92620e05280f"}]}] Jul 20 11:53:12.982747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:12.982747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: 0eb934ac079d4a428bea92620e05280f Jul 20 11:53:12.982747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:12.982747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-AttachVolumeTestJSON-1988218754-project Jul 20 11:53:12.982747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:53:12.982747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:53:12.982747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: 961ac5eb91a2432d971f4622620e4e1c Jul 20 11:53:12.982747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-AttachVolumeTestJSON-1988218754-project Jul 20 11:53:12.982747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: > Jul 20 11:53:12.982747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:53:12.982747 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'a026878a-994a-4ce9-8c8c-550e0631ef69'} Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:53:12.983780 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:53:12.985501 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:12.987183 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-0e331d86-02a6-4dea-a483-fcc0e12413de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Returning 404 to user: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:53:12.987183 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-0e331d86-02a6-4dea-a483-fcc0e12413de tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 404 len: 111 microversion: 2.1 time: 0.030748 Jul 20 11:53:12.987183 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 689/1390] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 11:53:12 2022] DELETE /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:53:12.987524 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1ba0bb56-cb2c-4a6a-9473-5cff18702318 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Calling method '>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:12.987965 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.compute.api [None req-1ba0bb56-cb2c-4a6a-9473-5cff18702318 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] [instance: a026878a-994a-4ce9-8c8c-550e0631ef69] Fetching instance by UUID {{(pid=124831) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:53:12.994368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1ba0bb56-cb2c-4a6a-9473-5cff18702318 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:12.994811 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1ba0bb56-cb2c-4a6a-9473-5cff18702318 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:12.995574 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1ba0bb56-cb2c-4a6a-9473-5cff18702318 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:53:12.996009 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG oslo_concurrency.lockutils [None req-1ba0bb56-cb2c-4a6a-9473-5cff18702318 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Lock "e43e925f-fe8b-4c11-b417-df3450f348d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:53:13.009627 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-1ba0bb56-cb2c-4a6a-9473-5cff18702318 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] HTTP exception thrown: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1ba0bb56-cb2c-4a6a-9473-5cff18702318 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Request method failure captured: Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 HTTP/1.1 Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-qaHs9ytbd3SDhbSUdhK9F76xxklEv1QTm_5pby9z9PixG8gtwZyB8qkx_58-MYxgiimAGs_UJoTa3jTXBk6dfObJ3QVZq37dNVY8v0VRoQbbFkO5rsWlCM5g0i7LEEglQvoY31DfpuxLDcPsLPVZL-uqFMI9llEz6BgMRKcyftrRQ Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: 0eb934ac079d4a428bea92620e05280f Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:53:13.011692 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:53:13.013513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0eb934ac079d4a428bea92620e05280f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0eb934ac079d4a428bea92620e05280f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0eb934ac079d4a428bea92620e05280f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0eb934ac079d4a428bea92620e05280f"}]}] Jul 20 11:53:13.013513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:13.013513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: 0eb934ac079d4a428bea92620e05280f Jul 20 11:53:13.013513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1988218754 Jul 20 11:53:13.013513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-AttachVolumeTestJSON-1988218754-project Jul 20 11:53:13.013513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:53:13.013513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:53:13.013513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: 961ac5eb91a2432d971f4622620e4e1c Jul 20 11:53:13.013513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-AttachVolumeTestJSON-1988218754-project Jul 20 11:53:13.013513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: > Jul 20 11:53:13.013513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:53:13.013513 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'a026878a-994a-4ce9-8c8c-550e0631ef69'} Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:53:13.014688 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. Jul 20 11:53:13.016368 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:13.017864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-1ba0bb56-cb2c-4a6a-9473-5cff18702318 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] Returning 404 to user: Instance a026878a-994a-4ce9-8c8c-550e0631ef69 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:53:13.017864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-1ba0bb56-cb2c-4a6a-9473-5cff18702318 tempest-AttachVolumeTestJSON-1988218754 tempest-AttachVolumeTestJSON-1988218754-project] 10.222.0.43 "GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69" status: 404 len: 111 microversion: 2.1 time: 0.029543 Jul 20 11:53:13.017864 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 702/1391] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 11:53:12 2022] GET /compute/v2.1/servers/a026878a-994a-4ce9-8c8c-550e0631ef69 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:53:18.810781 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56676ae2-c1ac-4a2a-bd23-54ed04419dc4 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Action: 'create', calling method: .version_select at 0x7f44e00fc040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-475424471", "metadata": {"Type": "work"}}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56676ae2-c1ac-4a2a-bd23-54ed04419dc4 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Request method failure captured: Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 121 Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-yu4ba8n0jZh9r3RV4IKmeUygwHo7Ra8PkH7IFKPX8Vny12d9bbMg4M1jgmbBez3AYtPJ7dEZ4_PLVK6RkHbkk7_Hcg0CIrk0ZW6cq4L_ukuD63j_SACPcaQR7IuHnhub4O0XJkgxMag8_1pkJulQKKwP204GvvnNKjn3SQkI_8I0s Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: e345e80f55a14a58b0735c268cc4a92f Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:53:18.830160 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:53:18.832142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e345e80f55a14a58b0735c268cc4a92f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e345e80f55a14a58b0735c268cc4a92f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e345e80f55a14a58b0735c268cc4a92f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e345e80f55a14a58b0735c268cc4a92f"}]}] Jul 20 11:53:18.832142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.832142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: e345e80f55a14a58b0735c268cc4a92f Jul 20 11:53:18.832142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.832142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesNegativeTest-1052361630-project Jul 20 11:53:18.832142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:53:18.832142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:53:18.832142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: c4ff766601b64add900920b047a7dd2e Jul 20 11:53:18.832142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesNegativeTest-1052361630-project Jul 20 11:53:18.832142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Jul 20 11:53:18.832142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-475424471", "metadata": {"Type": "work"}}} Jul 20 11:53:18.832142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: Jul 20 11:53:18.832142 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-475424471', 'metadata': {'Type': 'work'}}}} Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:53:18.833376 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:53:18.835340 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:53:18.837219 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 11:53:18.837219 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.837219 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-56676ae2-c1ac-4a2a-bd23-54ed04419dc4 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:53:18.837219 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-56676ae2-c1ac-4a2a-bd23-54ed04419dc4 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.136712 Jul 20 11:53:18.837219 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 690/1392] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jul 20 11:53:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:53:18.841847 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7fd69408-33e0-4c63-b57e-c23c981d2af8 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Action: 'create', calling method: .version_select at 0x7f44e38ef430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1608729119", "metadata": {"Type": "work"}}} {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7fd69408-33e0-4c63-b57e-c23c981d2af8 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Request method failure captured: Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 120 Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-yu4ba8n0jZh9r3RV4IKmeUygwHo7Ra8PkH7IFKPX8Vny12d9bbMg4M1jgmbBez3AYtPJ7dEZ4_PLVK6RkHbkk7_Hcg0CIrk0ZW6cq4L_ukuD63j_SACPcaQR7IuHnhub4O0XJkgxMag8_1pkJulQKKwP204GvvnNKjn3SQkI_8I0s Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: e345e80f55a14a58b0735c268cc4a92f Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:53:18.845236 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:53:18.847175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e345e80f55a14a58b0735c268cc4a92f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e345e80f55a14a58b0735c268cc4a92f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e345e80f55a14a58b0735c268cc4a92f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e345e80f55a14a58b0735c268cc4a92f"}]}] Jul 20 11:53:18.847175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.847175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: e345e80f55a14a58b0735c268cc4a92f Jul 20 11:53:18.847175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.847175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesNegativeTest-1052361630-project Jul 20 11:53:18.847175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:53:18.847175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:53:18.847175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: c4ff766601b64add900920b047a7dd2e Jul 20 11:53:18.847175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesNegativeTest-1052361630-project Jul 20 11:53:18.847175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Jul 20 11:53:18.847175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1608729119", "metadata": {"Type": "work"}}} Jul 20 11:53:18.847175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: Jul 20 11:53:18.847175 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1608729119', 'metadata': {'Type': 'work'}}}} Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi '0' Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:53:18.848427 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:53:18.850105 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:53:18.851760 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 11:53:18.851760 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.851760 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-7fd69408-33e0-4c63-b57e-c23c981d2af8 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:53:18.851760 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-7fd69408-33e0-4c63-b57e-c23c981d2af8 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010213 Jul 20 11:53:18.851760 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 703/1393] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jul 20 11:53:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:53:18.861323 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5983fd9e-0320-43d4-b9a1-29fed04a35b9 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Action: 'create', calling method: .version_select at 0x7f44e384f280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-762439673", "metadata": {"Type": "work"}}} {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5983fd9e-0320-43d4-b9a1-29fed04a35b9 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Request method failure captured: Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 118 Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-yu4ba8n0jZh9r3RV4IKmeUygwHo7Ra8PkH7IFKPX8Vny12d9bbMg4M1jgmbBez3AYtPJ7dEZ4_PLVK6RkHbkk7_Hcg0CIrk0ZW6cq4L_ukuD63j_SACPcaQR7IuHnhub4O0XJkgxMag8_1pkJulQKKwP204GvvnNKjn3SQkI_8I0s Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: e345e80f55a14a58b0735c268cc4a92f Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:53:18.864598 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:53:18.866704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e345e80f55a14a58b0735c268cc4a92f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e345e80f55a14a58b0735c268cc4a92f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e345e80f55a14a58b0735c268cc4a92f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e345e80f55a14a58b0735c268cc4a92f"}]}] Jul 20 11:53:18.866704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.866704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: e345e80f55a14a58b0735c268cc4a92f Jul 20 11:53:18.866704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.866704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesNegativeTest-1052361630-project Jul 20 11:53:18.866704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:53:18.866704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:53:18.866704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: c4ff766601b64add900920b047a7dd2e Jul 20 11:53:18.866704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesNegativeTest-1052361630-project Jul 20 11:53:18.866704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Jul 20 11:53:18.866704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-762439673", "metadata": {"Type": "work"}}} Jul 20 11:53:18.866704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: Jul 20 11:53:18.866704 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-762439673', 'metadata': {'Type': 'work'}}}} Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi '' Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:53:18.868284 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:53:18.870530 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:53:18.872210 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 11:53:18.872210 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.872210 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-5983fd9e-0320-43d4-b9a1-29fed04a35b9 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:53:18.872210 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-5983fd9e-0320-43d4-b9a1-29fed04a35b9 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008621 Jul 20 11:53:18.872210 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 691/1394] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jul 20 11:53:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:53:18.877880 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8cca0fd4-c00b-47f6-80cf-bb974d0e9063 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Calling method '.version_select at 0x7f44e3884310>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:18.910963 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-8cca0fd4-c00b-47f6-80cf-bb974d0e9063 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] HTTP exception thrown: Volume tempest-invalid-1358942733 could not be found. Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8cca0fd4-c00b-47f6-80cf-bb974d0e9063 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Request method failure captured: Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1358942733 HTTP/1.1 Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-yu4ba8n0jZh9r3RV4IKmeUygwHo7Ra8PkH7IFKPX8Vny12d9bbMg4M1jgmbBez3AYtPJ7dEZ4_PLVK6RkHbkk7_Hcg0CIrk0ZW6cq4L_ukuD63j_SACPcaQR7IuHnhub4O0XJkgxMag8_1pkJulQKKwP204GvvnNKjn3SQkI_8I0s Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: e345e80f55a14a58b0735c268cc4a92f Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:53:18.912323 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:53:18.914268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e345e80f55a14a58b0735c268cc4a92f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e345e80f55a14a58b0735c268cc4a92f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e345e80f55a14a58b0735c268cc4a92f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e345e80f55a14a58b0735c268cc4a92f"}]}] Jul 20 11:53:18.914268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.914268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: e345e80f55a14a58b0735c268cc4a92f Jul 20 11:53:18.914268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.914268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesNegativeTest-1052361630-project Jul 20 11:53:18.914268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:53:18.914268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:53:18.914268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: c4ff766601b64add900920b047a7dd2e Jul 20 11:53:18.914268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesNegativeTest-1052361630-project Jul 20 11:53:18.914268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: Jul 20 11:53:18.914268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Volume tempest-invalid-1358942733 could not be found. Jul 20 11:53:18.914268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'tempest-invalid-1358942733'} Jul 20 11:53:18.914268 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1358942733 could not be found. (HTTP 404) (Request-ID: req-d4da7793-af42-4988-8c68-f8a4327e9978) Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:18.916214 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 11:53:18.920056 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1358942733 could not be found. Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:53:18.922210 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1358942733 could not be found. Jul 20 11:53:18.924340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.924340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:18.924340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.924340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.924340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:18.924340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:18.924340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:53:18.924340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:53:18.924340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1358942733 could not be found. Jul 20 11:53:18.924340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.924340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-8cca0fd4-c00b-47f6-80cf-bb974d0e9063 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Returning 404 to user: Volume tempest-invalid-1358942733 could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:53:18.924340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-8cca0fd4-c00b-47f6-80cf-bb974d0e9063 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1358942733" status: 404 len: 99 microversion: 2.1 time: 0.039810 Jul 20 11:53:18.924340 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 704/1395] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jul 20 11:53:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1358942733 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:53:18.926021 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-029ceb07-6536-4213-90f7-7aedd2144b88 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003998 Jul 20 11:53:18.926021 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 692/1396] 10.222.0.43 () {58 vars in 1139 bytes} [Wed Jul 20 11:53:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 20 11:53:18.934757 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-91a20fcd-e623-4820-baf1-cc3b65dc9371 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004419 Jul 20 11:53:18.935273 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 705/1397] 10.222.0.43 () {58 vars in 1136 bytes} [Wed Jul 20 11:53:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 11:53:18.943975 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6dfee7f9-5c3a-4138-8226-d93449f1f21d tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Calling method '.version_select at 0x7f44e022e040>' {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:18.971996 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.wsgi [None req-6dfee7f9-5c3a-4138-8226-d93449f1f21d tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] HTTP exception thrown: Volume f6226280-64da-42e9-b07b-987f528258e4 could not be found. Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6dfee7f9-5c3a-4138-8226-d93449f1f21d tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Request method failure captured: Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: request: DELETE /compute/v2.1/os-volumes/f6226280-64da-42e9-b07b-987f528258e4 HTTP/1.1 Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept: application/json Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Accept-Encoding: identity Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Connection: close Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Length: 0 Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Content-Type: application/json Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Host: 10.222.0.43 Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Openstack-System-Scope: None Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: User-Agent: python-urllib3/1.26.9 Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Auth-Token: gAAAAABi1-yu4ba8n0jZh9r3RV4IKmeUygwHo7Ra8PkH7IFKPX8Vny12d9bbMg4M1jgmbBez3AYtPJ7dEZ4_PLVK6RkHbkk7_Hcg0CIrk0ZW6cq4L_ukuD63j_SACPcaQR7IuHnhub4O0XJkgxMag8_1pkJulQKKwP204GvvnNKjn3SQkI_8I0s Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Id: None Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Domain-Name: None Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Identity-Status: Confirmed Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Is-Admin-Project: True Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Id: default Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Domain-Name: Default Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Id: e345e80f55a14a58b0735c268cc4a92f Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Project-Name: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Role: member,reader Jul 20 11:53:18.974456 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Roles: member,reader Jul 20 11:53:18.976280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e345e80f55a14a58b0735c268cc4a92f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e345e80f55a14a58b0735c268cc4a92f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e345e80f55a14a58b0735c268cc4a92f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e345e80f55a14a58b0735c268cc4a92f"}]}] Jul 20 11:53:18.976280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.976280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Id: e345e80f55a14a58b0735c268cc4a92f Jul 20 11:53:18.976280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-Tenant-Name: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:18.976280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User: tempest-VolumesNegativeTest-1052361630-project Jul 20 11:53:18.976280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Id: default Jul 20 11:53:18.976280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Domain-Name: Default Jul 20 11:53:18.976280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Id: c4ff766601b64add900920b047a7dd2e Jul 20 11:53:18.976280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: X-User-Name: tempest-VolumesNegativeTest-1052361630-project Jul 20 11:53:18.976280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: method: Jul 20 11:53:18.976280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: exception: Volume f6226280-64da-42e9-b07b-987f528258e4 could not be found. Jul 20 11:53:18.976280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: action_args: {'id': 'f6226280-64da-42e9-b07b-987f528258e4'} Jul 20 11:53:18.976280 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: {{(pid=124830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6226280-64da-42e9-b07b-987f528258e4 could not be found. (HTTP 404) (Request-ID: req-23e68970-9e2f-4da4-9e96-3246ea5fc17a) Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:18.977492 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 11:53:18.979620 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6226280-64da-42e9-b07b-987f528258e4 could not be found. Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 11:53:18.981367 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6226280-64da-42e9-b07b-987f528258e4 could not be found. Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6226280-64da-42e9-b07b-987f528258e4 could not be found. Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: ERROR nova.api.openstack.wsgi Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: DEBUG nova.api.openstack.wsgi [None req-6dfee7f9-5c3a-4138-8226-d93449f1f21d tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Returning 404 to user: Volume f6226280-64da-42e9-b07b-987f528258e4 could not be found. {{(pid=124830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO nova.api.openstack.requestlog [None req-6dfee7f9-5c3a-4138-8226-d93449f1f21d tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/f6226280-64da-42e9-b07b-987f528258e4" status: 404 len: 109 microversion: 2.1 time: 0.036136 Jul 20 11:53:18.983065 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: [pid: 124830|app: 0|req: 693/1398] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 11:53:18 2022] DELETE /compute/v2.1/os-volumes/f6226280-64da-42e9-b07b-987f528258e4 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:53:18.987346 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e0cffdcf-6d7a-43f5-8837-7fffa44b4297 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Calling method '.version_select at 0x7f44e38673a0>' {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:53:19.014978 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.wsgi [None req-e0cffdcf-6d7a-43f5-8837-7fffa44b4297 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] HTTP exception thrown: Volume f6067af8-6cde-4cc6-b22d-684e833808dd could not be found. Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e0cffdcf-6d7a-43f5-8837-7fffa44b4297 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Request method failure captured: Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: request: GET /compute/v2.1/os-volumes/f6067af8-6cde-4cc6-b22d-684e833808dd HTTP/1.1 Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept: application/json Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Accept-Encoding: identity Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Connection: close Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Length: 0 Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Content-Type: application/json Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Host: 10.222.0.43 Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Openstack-System-Scope: None Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: User-Agent: python-urllib3/1.26.9 Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Auth-Token: gAAAAABi1-yu4ba8n0jZh9r3RV4IKmeUygwHo7Ra8PkH7IFKPX8Vny12d9bbMg4M1jgmbBez3AYtPJ7dEZ4_PLVK6RkHbkk7_Hcg0CIrk0ZW6cq4L_ukuD63j_SACPcaQR7IuHnhub4O0XJkgxMag8_1pkJulQKKwP204GvvnNKjn3SQkI_8I0s Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Id: None Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Domain-Name: None Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Identity-Status: Confirmed Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Is-Admin-Project: True Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Id: default Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Domain-Name: Default Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Id: e345e80f55a14a58b0735c268cc4a92f Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Project-Name: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Role: member,reader Jul 20 11:53:19.016985 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Roles: member,reader Jul 20 11:53:19.018813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e345e80f55a14a58b0735c268cc4a92f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e345e80f55a14a58b0735c268cc4a92f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e345e80f55a14a58b0735c268cc4a92f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e345e80f55a14a58b0735c268cc4a92f"}]}] Jul 20 11:53:19.018813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:19.018813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Id: e345e80f55a14a58b0735c268cc4a92f Jul 20 11:53:19.018813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-Tenant-Name: tempest-VolumesNegativeTest-1052361630 Jul 20 11:53:19.018813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User: tempest-VolumesNegativeTest-1052361630-project Jul 20 11:53:19.018813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Id: default Jul 20 11:53:19.018813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Domain-Name: Default Jul 20 11:53:19.018813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Id: c4ff766601b64add900920b047a7dd2e Jul 20 11:53:19.018813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: X-User-Name: tempest-VolumesNegativeTest-1052361630-project Jul 20 11:53:19.018813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: method: Jul 20 11:53:19.018813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: exception: Volume f6067af8-6cde-4cc6-b22d-684e833808dd could not be found. Jul 20 11:53:19.018813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: action_args: {'id': 'f6067af8-6cde-4cc6-b22d-684e833808dd'} Jul 20 11:53:19.018813 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: {{(pid=124831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6067af8-6cde-4cc6-b22d-684e833808dd could not be found. (HTTP 404) (Request-ID: req-50af7dff-2441-405e-a268-479041948c32) Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:19.020090 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:53:19.021722 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6067af8-6cde-4cc6-b22d-684e833808dd could not be found. Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 11:53:19.023304 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:53:19.024928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6067af8-6cde-4cc6-b22d-684e833808dd could not be found. Jul 20 11:53:19.024928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:19.024928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:53:19.024928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:19.024928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:53:19.024928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:53:19.024928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:53:19.024928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:53:19.024928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:53:19.024928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6067af8-6cde-4cc6-b22d-684e833808dd could not be found. Jul 20 11:53:19.024928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: ERROR nova.api.openstack.wsgi Jul 20 11:53:19.024928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: DEBUG nova.api.openstack.wsgi [None req-e0cffdcf-6d7a-43f5-8837-7fffa44b4297 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] Returning 404 to user: Volume f6067af8-6cde-4cc6-b22d-684e833808dd could not be found. {{(pid=124831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:53:19.024928 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO nova.api.openstack.requestlog [None req-e0cffdcf-6d7a-43f5-8837-7fffa44b4297 tempest-VolumesNegativeTest-1052361630 tempest-VolumesNegativeTest-1052361630-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f6067af8-6cde-4cc6-b22d-684e833808dd" status: 404 len: 109 microversion: 2.1 time: 0.034930 Jul 20 11:53:19.026228 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: [pid: 124831|app: 0|req: 706/1399] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 11:53:18 2022] GET /compute/v2.1/os-volumes/f6067af8-6cde-4cc6-b22d-684e833808dd => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:53:51.781193 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:53:51.781915 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Wed Jul 20 11:53:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:55:31.744607 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:55:31.745288 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Wed Jul 20 11:55:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:55:32.738584 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:55:32.738847 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Wed Jul 20 11:55:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:55:49.030973 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:55:49.031645 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Wed Jul 20 11:55:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:55:52.562250 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:55:52.562835 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Wed Jul 20 11:55:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:57:11.791624 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:57:11.792395 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Wed Jul 20 11:57:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:57:54.592027 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:57:54.592856 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Wed Jul 20 11:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:58:51.754157 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:58:51.754853 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Wed Jul 20 11:58:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:58:52.746617 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:58:52.746860 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Wed Jul 20 11:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:59:09.039866 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:59:09.041148 dv-cinder-822822-4-iscsi devstack@n-api.service[124831]: Wed Jul 20 11:59:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:59:12.570741 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:59:12.571218 dv-cinder-822822-4-iscsi devstack@n-api.service[124830]: Wed Jul 20 11:59:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!